Principle:Openai Openai python File Upload
| Knowledge Sources | |
|---|---|
| Domains | Data_Engineering, File_Management |
| Last Updated | 2026-02-15 00:00 GMT |
Overview
A data transfer pattern for uploading files to the OpenAI platform for use in fine-tuning, assistants, and batch processing.
Description
File upload transfers local data files to OpenAI's servers for processing. Two methods are available: single-request upload for smaller files and chunked multi-part upload for large files (supports resume on failure). Each upload is tagged with a purpose (fine-tune, assistants, batch) that determines how the file can be used.
Usage
Use single upload (files.create()) for files under 512MB. Use chunked upload (uploads.upload_file_chunked()) for large files or unreliable networks. The returned file ID is used in subsequent API calls (fine-tuning job creation, etc.).
Theoretical Basis
# Single upload
file_obj = upload(file=data, purpose="fine-tune")
# Returns FileObject with .id
# Chunked upload (large files)
upload_obj = upload_chunked(
file=large_data,
mime_type="application/jsonl",
purpose="fine-tune",
part_size=64_000_000, # 64MB chunks
)
# Returns Upload with nested FileObject