datafusion-ducklake

(★ 164)

A Rust-native DuckLake engine built on Apache DataFusion

File Explorer

Download Latest Version (.zip)

- config.toml
- - benchmark.yml
  - ci.yml
  - release.yml
- CODEOWNERS
- - datafusion_runner.rs
  - duckdb_runner.rs
  - main.rs
  - metrics.rs
  - report.rs
  - runner.rs
  - tpcds.rs
  - tpch.rs
- Cargo.toml
- rowid-lineage-physical-position-plan.md
- basic_query.rs
- compaction_demo.rs
- compare_rowid_against_duckdb.rs
- dump_sort.rs
- maintenance_demo.rs
- maintenance_demo.sql
- multicatalog_write.rs
- orphan_cleanup_demo.rs
- orphan_cleanup_demo.sql
- rowid_lifecycle.rs
- write_sorted.rs
- catalog.rs
- column_rename.rs
- compaction.rs
- delete_exec.rs
- delete_filter.rs
- encryption.rs
- error.rs
- information_schema.rs
- insert_exec.rs
- lib.rs
- maintenance.rs
- metadata_provider.rs
- metadata_provider_duckdb.rs
- metadata_provider_mysql.rs
- metadata_provider_postgres.rs
- metadata_provider_sqlite.rs
- metadata_writer.rs
- metadata_writer_duckdb.rs
- metadata_writer_mysql.rs
- metadata_writer_postgres.rs
- metadata_writer_postgres_single.rs
- metadata_writer_sqlite.rs
- multicatalog.rs
- multicatalog_provider.rs
- nan_pruning_barrier.rs
- partition.rs
- path_resolver.rs
- positional_source.rs
- row_id.rs
- schema.rs
- snapshot_filter.rs
- sort.rs
- sql.rs
- stats_collect.rs
- stats_encode.rs
- table.rs
- table_changes.rs
- table_deletions.rs
- table_functions.rs
- table_writer.rs
- types.rs
- update_exec.rs
- - append_with_deletes_postgres_tests.rs
  - append_with_deletes_tests.rs
  - cdc_cumulative_delete_tests.rs
  - cdc_differential_tests.rs
  - cdc_rowid_tests.rs
  - column_stats_tests.rs
  - compaction_postgres_tests.rs
  - compaction_sqlite_tests.rs
  - concurrent_tests.rs
  - concurrent_write_tests.rs
  - delete_filter_tests.rs
  - empty_data_file_tests.rs
  - encryption_tests.rs
  - files_matching_tests.rs
  - hybrid_asyncdb.rs
  - information_schema_test.rs
  - inlined_data_backends_tests.rs
  - inlined_data_sqlite_tests.rs
  - insert_partitioning_tests.rs
  - keyed_mutation_after_compaction_tests.rs
  - main.rs
  - maintenance_sqlite_tests.rs
  - missing_delete_file_tests.rs
  - multicatalog_hardening_tests.rs
  - multicatalog_postgres_tests.rs
  - multicatalog_provider_tests.rs
  - mysql_metadata_provider_test.rs
  - mysql_metadata_writer_test.rs
  - nested_field_id_schema_tests.rs
  - numeric_metadata_validation_tests.rs
  - object_store_integration_test.rs
  - partition_tests.rs
  - partition_write_duckdb_tests.rs
  - partition_write_tests.rs
  - positional_delete_oracle_postgres_tests.rs
  - positional_delete_oracle_tests.rs
  - positional_delete_tests.rs
  - postgres_metadata_provider_test.rs
  - postgres_single_catalog_write_tests.rs
  - renamed_columns_tests.rs
  - row_count_tests.rs
  - row_id_tests.rs
  - rowid_physical_position_tests.rs
  - sorted_write_duckdb_tests.rs
  - sorted_write_tests.rs
  - sql_delete_postgres_tests.rs
  - sql_delete_tests.rs
  - sql_update_postgres_tests.rs
  - sql_update_tests.rs
  - sql_write_tests.rs
  - sqlite_metadata_provider_test.rs
  - sqllogictest_runner.rs
  - table_changes_tests.rs
  - table_deletions_repartition_tests.rs
  - table_tests.rs
  - time_travel_tests.rs
  - type_promotion_tests.rs
  - write_tests.rs
- README.md
.gitignore
Cargo.lock
Cargo.toml
CHANGELOG.md
CLAUDE.md
COMPATIBILITY.md
LICENSE
README.md
rust-toolchain.toml
rustfmt.toml

# Installation Guide

1. Get the code

git clone https://github.com/datafusion-contrib/datafusion-ducklake

Downloads the entire project code from GitHub to your computer.

cd datafusion-ducklake

Moves into the project folder you just downloaded.

2. Rust

Medium Recommended

Prerequisites

Git Needed to download the project code from GitHub.
Rust (rustup) Installing via rustup also installs cargo.

cargo add datafusion-ducklake

Type this command into your terminal and run it.

cargo run --example basic_query --features metadata-postgres -- \

Builds and then immediately runs the program.

✅ If cargo build finishes without errors, it worked. The executable is created under target/.

Pulled directly from this repo's README.