-
Notifications
You must be signed in to change notification settings - Fork 11
Open
Description
DuckLake is DuckDB’s new lakehouse format: data remains in Parquet files, but metadata is efficiently tracked in a
separate DuckDB database.
- DuckLake supports function-based partitioning, which allows data to be partitioned by year and month. This enables
efficient file pruning ontp_timestampwithout needing a separatetp_datefilter. Atp_datecolumn will still
be present for compatibility, but it is no longer required for efficient query filtering. - Existing data should be automatically migrated when Tailpipe runs. Migration does not
occur if progress output is disabled (--progress=false) or when using machine-readable output (json,line,
csv).
Metadata
Metadata
Assignees
Labels
No labels