Implementation:Eventual Inc Daft Pyproject Configuration
| Knowledge Sources | |
|---|---|
| Domains | Build_System, Package_Management |
| Last Updated | 2026-02-08 14:00 GMT |
Overview
Concrete tool for defining the Python project metadata, build system configuration, optional dependency groups, and development tooling settings for the Daft package.
Description
The pyproject.toml file configures the Daft Python package using the maturin build backend (for Rust-Python hybrid builds). It declares:
- Core dependencies: pyarrow, fsspec, tqdm, typing-extensions, packaging
- Optional dependency groups: `ray`, `iceberg`, `deltalake`, `aws`, `azure`, `gcp`, `lance`, `sql`, `huggingface`, `google`, `openai`, `transformers`, `video`, `audio`, `unity`, `clickhouse`, `turbopuffer`, and an `all` meta-group
- Development dependency groups: `dev` (testing, tracing, pinned versions), `docs` (MkDocs toolchain), `lint` (ruff, black, mypy)
- Tool configurations: pytest, mypy, pyright, maturin, codespell, uv workspace
Usage
Consult this file when adding Python dependencies, configuring optional extras, or understanding the project's build and test toolchain. Install with extras using `pip install daft[ray]` or `pip install daft[all]`.
Code Reference
Source Location
- Repository: Eventual_Inc_Daft
- File: pyproject.toml
- Lines: 1-252
Signature
[build-system]
build-backend = "maturin"
requires = ["maturin>=1.5.0,<2.0.0"]
[project]
name = "daft"
description = "Distributed Dataframes for Multimodal Data"
requires-python = ">=3.10"
dependencies = [
"pyarrow >= 8.0.0,<23.0.0",
"fsspec<2025.11.0",
"tqdm<4.68.0",
"typing-extensions >= 4.0.0; python_version < '3.11'",
"packaging"
]
[project.optional-dependencies]
ray = ['ray[data, client]>=2.0.0,<2.53.0; platform_system != "Windows"']
iceberg = ["pyiceberg >= 0.7.0, < 0.9.1"]
deltalake = ["deltalake < 1.3.0"]
# ... additional groups
all = ["daft[aws, azure, clickhouse, deltalake, ...]"]
Import
# Not imported directly; consumed by pip/maturin
pip install daft
pip install "daft[ray,iceberg]"
pip install "daft[all]"
I/O Contract
Inputs
| Name | Type | Required | Description |
|---|---|---|---|
| build-system | TOML section | Yes | Specifies maturin as the build backend |
| project.dependencies | List[str] | Yes | Core runtime dependencies |
| project.optional-dependencies | Dict[str, List[str]] | No | Optional feature groups installable via `pip install daft[extra]` |
Outputs
| Name | Type | Description |
|---|---|---|
| daft wheel | .whl file | Built Python wheel containing compiled Rust extension and Python source |
| daft CLI | Entry point | `daft` command-line tool via `daft.cli:main` |
Usage Examples
Installing with Extras
# Install core Daft
pip install daft
# Install with Ray support
pip install "daft[ray]"
# Install with Iceberg and Delta Lake support
pip install "daft[iceberg,deltalake]"
# Install everything
pip install "daft[all]"
Semantic Links
Page Connections
Double-click a node to navigate. Hold to expand connections.
Principle
Implementation
Heuristic
Environment