sail
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
File Explorer
Download Latest Version (.zip)Showing a partial file list โ download the zip above to see everything.
- devcontainer.json
- Dockerfile
- action.yml
- action.yml
- action.yml
- action.yml
- action.yml
- action.yml
- action.yml
- spark-test-expert.agent.md
- query-time.svg
- dev.instructions.md
- python-review.instructions.md
- rust-review.instructions.md
- find-llvm-profdata.sh
- rustc-workspace-wrapper.sh
- restore_mtime.py
- save_mtime.py
- generate-release-notes.cjs
- get-previous-version.cjs
- build.yml
- catalog-tests.yml
- claude.yml
- copilot-setup-steps.yml
- docs-build.yml
- docs-deploy.yml
- docs-tag.yml
- gold-data-script-validation.yml
- gold-data.yml
- ibis-tests.yml
- multi-platform-build.yml
- pull-request-validation.yml
- python-lint.yml
- python-tests.yml
- release.yml
- report.yml
- rust-build.yml
- rust-lint.yml
- rust-tests.yml
- spark-package-artifacts.yml
- spark-tests.yml
- codecov.yml
- copilot-instructions.md
- dependabot.yml
- extensions.json
- settings.json
- mod.rs
- options.rs
- config.rs
- core.rs
- mod.rs
- operation.rs
- schema.rs
- docs.rs
- http.rs
- mod.rs
- name.rs
- types.rs
- mod.rs
- spec.rs
- error.rs
- lib.rs
- Cargo.toml
- error.rs
- file_listing_cache.rs
- file_metadata_cache.rs
- file_statistics_cache.rs
- lib.rs
- remote_checkpoint.rs
- Cargo.toml
- catalog.rs
- database.rs
- function.rs
- mod.rs
- table.rs
- tracker.rs
- view.rs
- cache.rs
- mod.rs
- namespace.rs
- options.rs
- runtime.rs
- command.rs
- credentials.rs
- error.rs
- hive_format.rs
- lakehouse.rs
- lib.rs
- temp_view.rs
- utils.rs
- Cargo.toml
- data_type.rs
- hive.rs
- iceberg.rs
- lib.rs
- managed_table.rs
- provider.rs
- Cargo.toml
- gssapi.rs
- gssapi_bindings.rs
- mod.rs
- thrift_sasl.rs
- convert.rs
- data_type.rs
- lib.rs
- managed_table.rs
- provider.rs
- Cargo.toml
- iceberg-rest-catalog.yaml
- adapter.rs
- lib.rs
- provider.rs
- build.rs
- Cargo.toml
- lib.rs
- managed_table.rs
- provider.rs
- Cargo.toml
- credentials.rs
- lib.rs
- provider.rs
- Cargo.toml
- lib.rs
- physical_plan.rs
- planner.rs
- predicate.rs
- provider.rs
- service.rs
- table_source.rs
- Cargo.toml
- unity-catalog-all.yaml
- config.rs
- credential.rs
- data_type.rs
- lib.rs
- provider.rs
- token.rs
- rest_integration_test.rs
- build.rs
- Cargo.toml
- transport.proto
- core.rs
- handler.rs
- message.rs
- mod.rs
- options.rs
- access.rs
- mod.rs
- client.rs
- mod.rs
- mod.rs
- transport.rs
- core.rs
- handler.rs
- message.rs
- mod.rs
- options.rs
- access.rs
- mod.rs
- client.rs
- mod.rs
- common.rs
- endpoint.rs
- error.rs
- lib.rs
- build.rs
- Cargo.toml
- mod.rs
- server.rs
- native_logging.py
- spark_mcp_server.py
- spark_run.py
- spark_shell.py
- mcp_server.rs
- mod.rs
- run.rs
- server.rs
- shell.rs
- entrypoint.rs
- mod.rs
- lib.rs
- main.rs
- python.rs
- runner.rs
- Cargo.toml
- application.rs
- application.yaml
- cli.rs
- loader.rs
- mod.rs
- observer.rs
- extension.rs
- mod.rs
- projjson.rs
- builder.rs
- mod.rs
- data_type.rs
- expression.rs
- literal.rs
- mod.rs
- plan.rs
- client.rs
- mod.rs
- server.rs
- common.rs
- futures.rs
- mod.rs
- recorder.rs
- datetime.rs
- debug.rs
- http.rs
- mod.rs
- object.rs
- retry.rs
- string.rs
- actor.rs
- error.rs
- lib.rs
- runtime.rs
- tests.rs
- catalog_hms_config.rs
- Cargo.toml
- databases.yaml
- marker.proto
- mod.rs
- placeholder.rs
- record_batch.rs
- serde.rs
- delta.rs
- display.rs
- iceberg.rs
- lakehouse.rs
- managed.rs
- mod.rs
- status.rs
- expression.rs
- logical_plan.rs
- mod.rs
- physical_plan.rs
- record_batch.rs
- schema.rs
- table_provider.rs
- activity.rs
- job.rs
- mod.rs
- plan.rs
- repartition.rs
- encoding.rs
- marker.rs
- mod.rs
- schema.rs
- stream.rs
- mod.rs
- source.rs
- mod.rs
- observable.rs
- predicate.rs
- types.rs
- datetime.rs
- items.rs
- mod.rs
- column_features.rs
- datasource.rs
- display.rs
- error.rs
- extension.rs
- formatter.rs
- lib.rs
- literal.rs
- logical_expr.rs
- logical_rewriter.rs
- schema_evolution.rs
- udf.rs
- variant.rs
- build.rs
- Cargo.toml
- lib.rs
- hive_metastore.thrift
- README.md
- build.rs
- Cargo.toml
- binary.yaml
- console.yaml
- csv.yaml
- json.yaml
- parquet.yaml
- rate.yaml
- socket.yaml
- text.yaml
- mod.rs
- read.rs
- write.rs
- mod.rs
- read.rs
- write.rs
- mod.rs
- options.rs
- read.rs
- reader.rs
- source.rs
- write.rs
- mod.rs
- options.rs
- writer.rs
- decoder.rs
- mod.rs
- options.rs
- read.rs
- source.rs
- write.rs
- mod.rs
- options.rs
- read.rs
- write.rs
- mod.rs
- writer.rs
- mod.rs
- options.rs
- read.rs
- write.rs
- arrow_utils.rs
- commit_exec.rs
- datasource.rs
- discovery.py
- discovery.rs
- error.rs
- exec.rs
- executor.rs
- filter.rs
- mod.rs
- stream.rs
- table_format.rs
- table_provider.rs
- write_exec.rs
- mod.rs
- options.rs
- reader.rs
- mod.rs
- options.rs
- reader.rs
- mod.rs
- options.rs
- read.rs
- reader.rs
- source.rs
- write.rs
- writer.rs
- mod.rs
- delete.rs
- input_files.rs
- mod.rs
- planner.rs
- source.rs
- table.rs
- utils.rs
- write.rs
- mod.rs
- parsers.rs
- error.rs
- lib.rs
- url.rs
- utils.rs
- build.rs
- Cargo.toml
- delta.yaml
- coordinator.rs
- mod.rs
- action_fields.rs
- mod.rs
- mod.rs
- scalar.rs
- type_promotion.rs
- actions.rs
- expressions.rs
- mod.rs
- pruning.rs
- scan.rs
- schema.rs
- bitmap.rs
- mod.rs
- resolve.rs
- storage.rs
- z85.rs
- config.rs
- cleanup.rs
- listing.rs
- mod.rs
- replay.rs
- segment.rs
- segment_files.rs
- store.rs
- timestamps.rs
- merge.rs
- mod.rs
- table_source.rs
- mod.rs
- scan_planner.rs
- table_scan_planner.rs
- commit.rs
- context.rs
- log_scan.rs
- log_segment.rs
- metadata_predicate.rs
- mod.rs
- op_delete.rs
- op_merge.rs
- op_update.rs
- op_write.rs
- row_level.rs
- utils.rs
- action_schema.rs
- commit_exec.rs
- discovery_exec.rs
- dv_writer_exec.rs
- log_replay_exec.rs
- meta_adds.rs
- metadata_stats_exec.rs
- mod.rs
- remove_actions_exec.rs
- scan_by_adds_exec.rs
- write_context.rs
- writer_exec.rs
- writer_options.rs
- arrow_conversions.rs
- converter.rs
- manager.rs
- mapping.rs
- mod.rs
- normalize.rs
- type_widening.rs
- config.rs
- materialize.rs
- mod.rs
- stats.rs
- action_schema.rs
- actions.rs
- checkpoint.rs
- checksum.rs
- error.rs
- fields.rs
- log.rs
- metadata.rs
- mod.rs
- operation.rs
- properties.rs
- protocol.rs
- schema.rs
- statistics.rs
- utils.rs
- features.rs
- mod.rs
- conflict_checker.rs
- mod.rs
- protocol.rs
- async_buffer.rs
- mod.rs
- partitioning.rs
- stats.rs
- variant_shredding.rs
- catalog_managed.rs
- error.rs
- lib.rs
- options.rs
- session_extension.rs
- table_format.rs
- build.rs
- Cargo.toml
- celeborn.proto
- service.proto
- physical.proto
- common.proto
- common.proto
- service.proto
- core.rs
- handler.rs
- message.rs
- mod.rs
- options.rs
- common.rs
- mod.rs
- service.rs
- core.rs
- mod.rs
- observer.rs
- options.rs
- state.rs
- topology.rs
- core.rs
- mod.rs
- options.rs
- state.rs
- core.rs
- mod.rs
- observer.rs
- options.rs
- state.rs
- client.rs
- gateway.rs
- mod.rs
- output.rs
- registry.rs
- server.rs
- mod.rs
- planner.rs
- mod.rs
- shuffle_read.rs
- shuffle_write.rs
- stage_input.rs
- codec.rs
- converter.rs
- decode.rs
- encode.rs
- mod.rs
- core.rs
- lifecycle.rs
- mod.rs
- core.rs
- memory.rs
- mod.rs
- options.rs
- client.rs
- mod.rs
- server.rs
- core.rs
- mod.rs
- accessor.rs
- error.rs
- merge.rs
- mod.rs
- reader.rs
- writer.rs
- definition.rs
- mod.rs
- scheduling.rs
- core.rs
- handler.rs
- message.rs
- mod.rs
- options.rs
- mod.rs
- monitor.rs
- core.rs
- handler.rs
- message.rs
- mod.rs
- options.rs
- rpc.rs
- core.rs
- mod.rs
- options.rs
- client.rs
- debug.rs
- entrypoint.rs
- mod.rs
- server.rs
- kubernetes.rs
- local.rs
- mod.rs
- options.rs
- error.rs
- id.rs
- job_runner.rs
- lib.rs
- rpc.rs
- shuffle.rs
- build.rs
- Cargo.toml
- entrypoint.rs
- error.rs
- lib.rs
- metrics.rs
- service.rs
- session.rs
- state.rs
- Cargo.toml
- bitmap_and_agg.rs
- bitmap_construct_agg.rs
- bitmap_or_agg.rs
- count_min_sketch.rs
- grouping_id.rs
- histogram_numeric.rs
- hll_sketch.rs
- kurtosis.rs
- max_min_by.rs
- mod.rs
- mode.rs
- percentile.rs
- percentile_disc.rs
- percentile_disc_groups.rs
- product.rs
- regr.rs
- schema_of_variant_agg.rs
- skewness.rs
- theta_sketch.rs
- try_avg.rs
- utils.rs
- array_intersect.rs
- array_position.rs
- arrays_zip.rs
- lambda_utils.rs
- mod.rs
- spark_array.rs
- spark_array_aggregate.rs
- spark_array_compact.rs
- spark_array_exists.rs
- spark_array_filter.rs
- spark_array_forall.rs
- spark_array_item_with_position.rs
- spark_array_min_max.rs
- spark_array_sort.rs
- spark_array_transform.rs
- spark_sequence.rs
- mod.rs
- spark_concat.rs
- spark_reverse.rs
- mod.rs
- options.rs
- schema_of_csv.rs
- spark_from_csv.rs
- spark_to_csv.rs
- formatting.rs
- locale.rs
- mod.rs
- parser.rs
- parsing.rs
- pattern.rs
- convert_tz.rs
- mod.rs
- negate_duration.rs
- spark_date.rs
- spark_date_format.rs
- spark_date_part.rs
- spark_date_trunc.rs
- spark_interval.rs
- spark_last_day.rs
- spark_make_time.rs
- spark_make_timestamp_ntz.rs
- spark_make_ym_interval.rs
- spark_next_day.rs
- spark_time.rs
- spark_time_diff.rs
- spark_time_trunc.rs
- spark_timestamp.rs
- spark_try_to_timestamp.rs
- spark_unix_timestamp.rs
- spark_window_buckets.rs
- spark_year.rs
- timestamp_now.rs
- utils.rs
- mod.rs
- st_asbinary.rs
- st_geogfromwkb.rs
- st_geomfromwkb.rs
- wkb_reader.rs
- mod.rs
- spark_murmur3_hash.rs
- utils.rs
- common.rs
- common_union.rs
- from_json.rs
- json_as_text.rs
- json_length.rs
- json_object_keys.rs
- mod.rs
- schema_of_json.rs
- to_json.rs
- map_entries.rs
- map_from.rs
- mod.rs
- str_to_map.rs
- utils.rs
- decimal.rs
- mod.rs
- try_op.rs
- java_random.rs
- mod.rs
- rand_poisson.rs
- randn.rs
- random.rs
- spark_abs.rs
- spark_bin.rs
- spark_bround.rs
- spark_ceil_floor.rs
- spark_conv.rs
- spark_div.rs
- spark_negative.rs
- spark_pmod.rs
- spark_signum.rs
- spark_try_add.rs
- spark_try_div.rs
- spark_try_mod.rs
- spark_try_mult.rs
- spark_try_subtract.rs
- spark_unhex.rs
- spark_uniform.rs
- xorshift.rs
- hll_sketch.rs
- mod.rs
- monotonically_increasing_id.rs
- raise_error.rs
- spark_aes.rs
- spark_partition_id.rs
- theta_sketch.rs
- version.rs
- mod.rs
- rewrite_like_pattern.rs
- decimal_format.rs
- format_number.rs
- levenshtein.rs
- make_valid_utf8.rs
- mod.rs
- randstr.rs
- soundex.rs
- spark_base64.rs
- spark_concat_ws.rs
- spark_encode_decode.rs
- spark_length.rs
- spark_mask.rs
- spark_quote.rs
- spark_regexp_extract_all.rs
- spark_sentences.rs
- spark_split.rs
- spark_to_binary.rs
- spark_to_char.rs
- spark_to_number.rs
- mod.rs
- parse_url.rs
- spark_try_parse_url.rs
- helper.rs
- mod.rs
- mod.rs
- spark_cast_to_variant.rs
- spark_is_variant_null.rs
- spark_parse_json.rs
- spark_schema_of_variant.rs
- spark_to_variant_object.rs
- spark_variant_explode.rs
- spark_variant_get.rs
- spark_variant_to_json.rs
- inner_product.rs
- mod.rs
- from_xml.rs
- mod.rs
- to_xml.rs
- xpath.rs
- xpath_typed.rs
- array_struct_field.rs
- drop_struct_field.rs
- explode.rs
- mod.rs
- multi_expr.rs
- spark_cast_string_to_int32.rs
- spark_struct_rename.rs
- spark_to_string.rs
- struct_function.rs
- table_input.rs
- update_struct_field.rs
- mod.rs
- spark_first_last_value.rs
- spark_ntile.rs
- error.rs
- functions_nested_utils.rs
- functions_utils.rs
- hll_sketch.rs
- lib.rs
- schema_inference.rs
- theta_sketch.rs
- Cargo.toml
- main.rs
- function.rs
- mod.rs
- parser.rs
- common.rs
- mod.rs
- writer.rs
- mod.rs
- lib.rs
- Cargo.toml
- iceberg.yaml
- commit.rs
- mod.rs
- expressions.rs
- mod.rs
- provider.rs
- pruning.rs
- type_converter.rs
- mod.rs
- merge.rs
- mod.rs
- table_source.rs
- data_file_writer.rs
- mod.rs
- location_generator.rs
- mod.rs
- arrow_parquet.rs
- config.rs
- mod.rs
- partition.rs
- table_writer.rs
- variant_shredding.rs
- action.rs
- append.rs
- bootstrap.rs
- helpers.rs
- mod.rs
- overwrite.rs
- snapshot.rs
- mod.rs
- row_level_planner.rs
- table_scan_planner.rs
- commit_exec.rs
- mod.rs
- action_schema.rs
- delete_apply_exec.rs
- delete_writer_common.rs
- discovery_exec.rs
- equality_delete_writer_exec.rs
- manifest_scan_exec.rs
- merge_metadata_exec.rs
- merge_row_projection.rs
- mod.rs
- partition_transform_expr.rs
- plan_builder.rs
- position_delete_writer.rs
- scan_by_data_files_exec.rs
- write_context.rs
- write_location.rs
- writer_exec.rs
- writer_options.rs
- metadata_location.rs
- mod.rs
- _serde.rs
- data_file.rs
- entry.rs
- metadata.rs
- mod.rs
- schema.rs
- writer.rs
- schema.rs
- format.rs
- mod.rs
- statistic_file.rs
- table_metadata.rs
- table_metadata_builder.rs
- mod.rs
- mod.rs
- spec.rs
- unbound.rs
- mod.rs
- utils.rs
- visitor.rs
- mod.rs
- snapshot.rs
- summary.rs
- mod.rs
- values.rs
- mod.rs
- view_metadata.rs
- view_metadata_builder.rs
- view_version.rs
- avro_utils.rs
- delete_index.rs
- encrypted_key.rs
- manifest_list.rs
- mod.rs
- sort.rs
- transform.rs
- metadata_loader.rs
- mod.rs
- conversions.rs
- metadata.rs
- mod.rs
- partition_transform.rs
- snapshot_id.rs
- timestamp.rs
- transform.rs
- error.rs
- lib.rs
- options.rs
- properties.rs
- row_level_metadata.rs
- schema_evolution.rs
- table_format.rs
- build.rs
- Cargo.toml
- lateral_join.rs
- lib.rs
- resolve_lambda_variables.rs
- Cargo.toml
- collector.rs
- filter.rs
- limit.rs
- mod.rs
- source_adapter.rs
- source_wrapper.rs
- barrier.rs
- check_constraints.rs
- lib.rs
- map_partitions.rs
- merge.rs
- monotonic_id.rs
- range.rs
- remote_checkpoint.rs
- repartition.rs
- schema_pivot.rs
- show_string.rs
- sort.rs
- spark_partition_id.rs
- Cargo.toml
- lazy.rs
- logging.rs
- mod.rs
- runtime.rs
- hugging_face.rs
- lib.rs
- path.rs
- registry.rs
- s3.rs
- Cargo.toml
- builder.rs
- cardinality_estimator.rs
- cost_model.rs
- dp_plan.rs
- enumerator.rs
- graph.rs
- join_set.rs
- mod.rs
- reconstructor.rs
- barrier.rs
- collect_left.rs
- explicit_repartition.rs
- lib.rs
- projection_pushdown.rs
- Cargo.toml
- collector.rs
- filter.rs
- limit.rs
- mod.rs
- source_adapter.rs
- barrier.rs
- catalog_command.rs
- coalesce.rs
- data_source.rs
- lib.rs
- map_partitions.rs
- merge_cardinality_check.rs
- monotonic_id.rs
- range.rs
- remote_checkpoint.rs
- repartition.rs
- schema_pivot.rs
- show_string.rs
- spark_partition_id.rs
- Cargo.toml
- array.yaml
- bitwise.yaml
- collection.yaml
- conditional.yaml
- conversion.yaml
- csv.yaml
- datetime.yaml
- geo.yaml
- hash.yaml
- json.yaml
- map.yaml
- math.yaml
- misc.yaml
- predicate.yaml
- string.yaml
- struct.yaml
- url.yaml
- variant.yaml
- vector.yaml
- xml.yaml
- range.yaml
- aggregate.yaml
- generator.yaml
- window.yaml
- array.rs
- bitwise.rs
- collection.rs
- conditional.rs
- conversion.rs
- csv.rs
- datetime.rs
- geo.rs
- hash.rs
- json.rs
- lambda.rs
- map.rs
- math.rs
- misc.rs
- mod.rs
- predicate.rs
- string.rs
- struct.rs
- url.rs
- variant.rs
- vector.rs
- xml.rs
- mod.rs
- range.rs
- aggregate.rs
- common.rs
- generator.rs
- metadata.rs
- mod.rs
- window.rs
- database.rs
- mod.rs
- table.rs
- view.rs
- checkpoint.rs
- delete.rs
- delta.rs
- explain.rs
- function.rs
- insert.rs
- merge.rs
- mod.rs
- show.rs
- variable.rs
- with_relations.rs
- write.rs
- write_stream.rs
- write_v1.rs
- write_v2.rs
- attribute.rs
- cast.rs
- function.rs
- grouping.rs
- lambda.rs
- literal.rs
- misc.rs
- mod.rs
- predicate.rs
- sort.rs
- subquery.rs
- udf.rs
- wildcard.rs
- window.rs
- aggregate.rs
- alias.rs
- column_op.rs
- cte.rs
- dedup.rs
- filter.rs
- join.rs
- lateral.rs
- lateral_join.rs
- limit.rs
- misc.rs
- mod.rs
- na.rs
- pivoting.rs
- project.rs
- read.rs
- recursion.rs
- repartition.rs
- sample.rs
- set_op.rs
- sort.rs
- stat.rs
- time_travel.rs
- udf.rs
- udtf.rs
- values.rs
- window.rs
- with_relations.rs
- explode.rs
- mod.rs
- monotonic_id.rs
- spark_partition_id.rs
- table_input.rs
- window.rs
- constraint.rs
- data_type.rs
- function.rs
- lakehouse.rs
- literal.rs
- mod.rs
- plan.rs
- schema.rs
- state.rs
- mod.rs
- rewriter.rs
- catalog.rs
- config.rs
- error.rs
- explain.rs
- formatter.rs
- lib.rs
- build.rs
- Cargo.toml
- lib.rs
- Cargo.toml
- glue.rs
- hms.rs
- iceberg.rs
- mod.rs
- provider.rs
- status.rs
- endpoint.rs
- lifecycle.rs
- mod.rs
- shuffle.rs
- mod.rs
- server.rs
- mod.rs
- server.rs
- cli.rs
- globals.rs
- lib.rs
- Cargo.toml
- mod.rs
- pyspark_udf.rs
- pyspark_udtf.rs
- mod.rs
- spark.py
- spark.rs
- mod.rs
- pyspark_batch_collector.rs
- pyspark_cogroup_map_udf.rs
- pyspark_group_map_udf.rs
- pyspark_map_iter_udf.rs
- pyspark_udaf.rs
- pyspark_udf.rs
- pyspark_udtf.rs
- pyspark_unresolved_udf.rs
- accumulator.rs
- array.rs
- config.rs
- conversion.rs
- error.rs
- lazy.rs
- lib.rs
- name.rs
- stream.rs
- Cargo.toml
- job_runner.rs
- mod.rs
- server.rs
- worker.rs
- core.rs
- handler.rs
- message.rs
- mod.rs
- options.rs
- mod.rs
- session.rs
- catalog.rs
- error.rs
- formats.rs
- lib.rs
- observable.rs
- optimizer.rs
- planner.rs
- runtime.rs
- Cargo.toml
- spark-3.5.json
- spark-4.0.json
- spark-4.1.json
- spark-4.2.json
- base.proto
- catalog.proto
- commands.proto
- common.proto
- example_plugins.proto
- expressions.proto
- ml.proto
- ml_common.proto
- pipelines.proto
- relations.proto
- types.proto
- analyzer.rs
- common.rs
- data_type.rs
- data_type_arrow.rs
- data_type_json.rs
- expression.rs
- function.rs
- literal.rs
- mod.rs
- plan.rs
- artifact_manager.rs
- config_manager.rs
- mod.rs
- plan_analyzer.rs
- plan_executor.rs
- config.rs
- debug.rs
- entrypoint.rs
- error.rs
- executor.rs
- lib.rs
- schema.rs
- server.rs
- session.rs
- session_manager.rs
- streaming.rs
- case.json
- cast.json
- current.json
- date.json
- interval.json
- large.json
- like.json
- misc.json
- numeric.json
- string.json
- timestamp.json
- window.json
- agg.json
- array.json
- avro.json
- bitwise.json
- collection.json
- conditional.json
- conversion.json
- csv.json
- datetime.json
- generator.json
- hash.json
- json.json
- lambda.json
- map.json
- math.json
- misc.json
- predicate.json
- protobuf.json
- sketch.json
- st.json
- string.json
- struct.json
- url.json
- variant.json
- vector.json
- window.json
- xml.json
- ddl_alter_table.json
- ddl_alter_view.json
- ddl_analyze_table.json
- ddl_cache.json
- ddl_create_index.json
- ddl_create_table.json
- ddl_delete_from.json
- ddl_describe.json
- ddl_drop_index.json
- ddl_drop_view.json
- ddl_insert_into.json
- ddl_insert_overwrite.json
- ddl_load_data.json
- ddl_merge_into.json
- ddl_misc.json
- ddl_replace_table.json
- ddl_select.json
- ddl_show_views.json
- ddl_uncache.json
- ddl_update.json
- error_alter_table.json
- error_analyze_table.json
- error_create_table.json
- error_describe.json
- error_join.json
- error_load_data.json
- error_misc.json
- error_order_by.json
- error_select.json
- error_with.json
- plan_alter_view.json
- plan_create_view.json
- plan_explain.json
- plan_group_by.json
- plan_hint.json
- plan_insert_into.json
- plan_insert_overwrite.json
- plan_join.json
- plan_misc.json
- plan_order_by.json
- plan_select.json
- plan_set_operation.json
- plan_with.json
- unpivot_join.json
- unpivot_select.json
- data_type.json
- table_schema.json
- build.rs
- Cargo.toml
- binary.rs
- datetime.rs
- interval.rs
- mod.rs
- numeric.rs
- utils.rs
- data_type.rs
- error.rs
- expression.rs
- lib.rs
- parser.rs
- query.rs
- statement.rs
- value.rs
- Cargo.toml
- mod.rs
- parser.rs
- syntax.rs
- text.rs
- attribute.rs
- lib.rs
- utils.rs
- Cargo.toml
- keywords.txt
- data_type.rs
- expression.rs
- identifier.rs
- keywords.rs
- literal.rs
- mod.rs
- operator.rs
- query.rs
- statement.rs
- box.rs
- either.rs
- mod.rs
- option.rs
- sequence.rs
- tuple.rs
- vec.rs
- mod.rs
- parser.rs
- syntax.rs
- text.rs
- combinator.rs
- common.rs
- lexer.rs
- lib.rs
- location.rs
- options.rs
- parser.rs
- span.rs
- string.rs
- token.rs
- utils.rs
- syntax.json
- syntax.rs
- build.rs
- Cargo.toml
- default.rs
- filter.rs
- join.rs
- mod.rs
- projection.rs
- testing.rs
- join_set.rs
- mod.rs
- physical_plan.rs
- composite.rs
- mod.rs
- span.rs
- attributes.yaml
- registry.yaml
- instruments.rs
- mod.rs
- error.rs
- lib.rs
- telemetry.rs
- build.rs
- Cargo.toml
- celeborn-defaults.conf
- grafana-datasources.yaml
- otel-collector-debug.yaml
- prometheus.yaml
- tempo.yaml
- Dockerfile
- Dockerfile
- Dockerfile
- ConfigGroupList.vue
- ConfigList.vue
- FunctionSupportTable.vue
- MarkdownBlock.vue
- PageList.vue
- PageTreeList.vue
- PySparkApi.vue
- SphinxIndexPage.vue
- SphinxPage.vue
- SvgDiagram.vue
- SyntaxBlock.vue
- SyntaxText.vue
- SystemDatabaseList.vue
- SystemTableList.vue
- pycon.ts
- MainLayout.vue
- config.ts
- file.ts
- function-support.ts
- graphviz.ts
- link.ts
- page.ts
- sphinx-plugins.ts
- sphinx.ts
- svgo-plugins.ts
- system-catalog.ts
- tree.ts
- vega.ts
- app.css
- index.ts
- config.mts
- site.d.ts
- architecture-cluster.dot
- architecture-local.dot
- index.data.ts
- index.md
- index.md
- index.data.ts
- index.md
- planning.dot
- index.data.ts
- index.md
- server-issue.md
- index.data.ts
- index.md
- python.md
- rust.md
- index.md
- index.md
- benchmark.md
- cross-compilation.md
- debugger.md
- hms.md
- index.data.ts
- index.md
- mcp-server.md
- object-store.md
- pyspark-local.md
- reducing-build-time.md
- spark-gold-data.md
- spark-version-update.md
- standalone-binary.md
- index.md
- index.data.ts
- index.md
- java.md
- prerequisites.md
- python.md
- github-actions.md
- index.data.ts
- index.md
- log-analysis.md
- spark-patch.md
- spark-setup.md
- test-ibis.md
- test-spark.md
- index.data.ts
- index.md
- spark-session.md
- databases.data.ts
- databases.md
- index.md
- tables.md
- glue.md
- hms.md
- iceberg-rest.md
- index.md
- memory.md
- onelake.md
- unity.md
- index.md
- index.md
- arrow.md
- compatibility.md
- floating-point.md
- index.data.ts
- index.md
- overview.md
- features.md
- index.data.ts
- index.md
- python-version.md
- support.md
- development.md
- index.data.ts
- index.md
- production.md
- quick-start.md
- index.data.ts
- index.md
- kubernetes.md
- notice.md
- aggregate.md
- generator.md
- index.data.ts
- index.md
- scalar.md
- support.data.ts
- table.md
- window.md
- pyspark-skill.md
- agent-skills.md
- dbt.md
- flight-sql.md
- ibis.md
- index.data.ts
- index.md
- langchain.md
- mcp-server.md
- index.md
- examples.md
- features.md
- index.data.ts
- index.md
- examples.md
- features.md
- index.data.ts
- index.md
- index.md
- index.md
- index.md
- index.md
- compatibility.md
- index.data.ts
- index.md
- binary.md
- boolean.md
- datetime.md
- index.data.ts
- index.md
- interval.md
- null.md
- numeric.md
- string.md
- features.md
- identifiers.md
- index.data.ts
- index.md
- operators.md
- azure.md
- fs.md
- gcs.md
- hdfs.md
- hf.md
- index.md
- memory.md
- s3.md
- index.md
- examples.md
- index.data.ts
- index.md
- performance.md
- index.data.ts
- index.md
- events-sail.json
- events-spark.json
- query-time-sail.json
- query-time-spark.json
- resource-utilization-sail.csv
- resource-utilization-spark.csv
- index.data.ts
- index.md
- query-speed-up.vega.json
- query-time.vega.json
- resource-utilization.vega.json
- index.md
- index.md
- index.md
- index.md
- index.md
- banner.png
- favicon.png
- logo.png
- index.md
- index.data.ts
- index.md
- [page].md
- [page].paths.ts
- index.md
- python.md
- index.md
- kind-config.yaml
- kustomization.yaml
- sail.yaml
- test-volume-patch.yaml
- queries.sql
- array.json
- bitwise.json
- collection.json
- conditional.json
- conversion.json
- csv.json
- datetime.json
- geo.json
- hash.json
- json.json
- map.json
- math.json
- misc.json
- normal.json
- predicate.json
- sort.json
- string.json
- struct.json
- udf_udtf_udt.json
- url.json
- variant.json
- xml.json
- aggregate.json
- generator.json
- window.json
- catalog.json
- column.json
- dataframe.json
- sparksession.json
- structtype.json
- q1.sql
- q10.sql
- q11.sql
- q12.sql
- q13.sql
- q14.sql
- q15.sql
- q16.sql
- q17.sql
- q18.sql
- q19.sql
- q2.sql
- q20.sql
- q21.sql
- q22.sql
- q23.sql
- q24.sql
- q25.sql
- q26.sql
- q27.sql
- q28.sql
- q29.sql
- q3.sql
- q30.sql
- q31.sql
- q32.sql
- q33.sql
- q34.sql
- q35.sql
- q36.sql
- q37.sql
- q38.sql
- q39.sql
- q4.sql
- q40.sql
- q41.sql
- q42.sql
- q43.sql
- q44.sql
- q45.sql
- q46.sql
- q47.sql
- q48.sql
- q49.sql
- q5.sql
- q50.sql
- q51.sql
- q52.sql
- q53.sql
- q54.sql
- q55.sql
- q56.sql
- q57.sql
- q58.sql
- q59.sql
- q6.sql
- q60.sql
- q61.sql
- q62.sql
- q63.sql
- q64.sql
- q65.sql
- q66.sql
- q67.sql
- q68.sql
- q69.sql
- q7.sql
- q70.sql
- q71.sql
- q72.sql
- q73.sql
- q74.sql
- q75.sql
- q76.sql
- q77.sql
- q78.sql
- q79.sql
- q8.sql
- q80.sql
- q81.sql
- q82.sql
- q83.sql
- q84.sql
- q85.sql
- q86.sql
- q87.sql
- q88.sql
- q89.sql
- q9.sql
- q90.sql
- q91.sql
- q92.sql
- q93.sql
- q94.sql
- q95.sql
- q96.sql
- q97.sql
- q98.sql
- q99.sql
- q1.sql
- q10.sql
- q11.sql
- q12.sql
- q13.sql
- q14.sql
- q15.sql
- q16.sql
- q17.sql
- q18.sql
- q19.sql
- q2.sql
- q20.sql
- q21.sql
- q22.sql
- q3.sql
- q4.sql
- q5.sql
- q6.sql
- q7.sql
- q8.sql
- q9.sql
- class.rst
- .gitignore
- conf.py
- flight.rst
- index.rst
- spark.rst
- __init__.py
- compatibility_check.py
- convert_to_delta.py
- onelake_catalog.py
- tpch.py
- __init__.py
- __init__.py
- __init__.py
- jdbc.py
- vortex.py
- __init__.py
- _function_scanner.py
- _function_support.py
- __init__.py
- bootstrap-kdc.sh
- Dockerfile
- kdc-entrypoint.sh
- README.md
- __init__.py
- celeborn-defaults.conf
- celeborn.py
- glue.py
- hms.py
- hms_probe.py
- iceberg_rest.py
- __init__.py
- yaml.py
- __init__.py
- delta.py
- files.py
- iceberg.py
- plan.py
- sql.py
- __init__.py
- common.py
- files.py
- jvm.py
- sql.py
- __init__.py
- session.py
- __init__.py
- proxy.py
- __init__.py
- __init__.py
- conftest.py
- test_catalog.py
- __init__.py
- conftest.py
- test_catalog.py
- test_kerberos.py
- __init__.py
- conftest.py
- test_catalog.py
- __init__.py
- __init__.py
- test_lifecycle.py
- test_shuffle.py
- __init__.py
- conftest.py
- test_flight.py
- test_clickbench.plan.yaml
- test_tpcds.plan.yaml
- test_tpcds.result.yaml
- test_tpch.plan.yaml
- test_tpch.result.yaml
- explain.yaml
- explain.feature
- values.feature
- __init__.py
- test_features.py
- system.yaml
- database_namespace.feature
- function.feature
- memory_database_drop.feature
- system.feature
- table_identifier.feature
- temp_view_using.feature
- view.feature
- database.feature
- table.feature
- view.feature
- __init__.py
- conftest.py
- test_delta_commit.py
- test_features.py
- test_glue_partition_transforms.py
- test_iceberg_commit.py
- __init__.py
- conftest.py
- test_hms_s3_roundtrip.py
- test_hms_smoke.py
- test_iceberg_catalog_commit.py
- test_sail_to_spark_roundtrip.py
- test_spark_to_sail_dsv2_roundtrip.py
- test_spark_to_sail_roundtrip.py
- namespace.feature
- table.feature
- view.feature
- __init__.py
- conftest.py
- test_commit.py
- test_lakekeeper.py
- test_namespace_features.py
- test_namespace_separator_custom.py
- test_namespace_separator_incorrect.py
- test_nessie.py
- test_sort_order.py
- test_table_features.py
- test_view_features.py
- test_view_metadata.py
- managed_delta.feature
- schema.feature
- table.feature
- __init__.py
- conftest.py
- test_managed_delta_dataframe.py
- test_managed_delta_features.py
- test_schema_features.py
- test_table_features.py
- __init__.py
- conftest.py
- test_database.py
- test_features.py
- test_function.py
- test_list_catalogs.txt
- test_table.py
- test_temp_view.txt
- test_temp_view_columns.txt
- test_checkpoint.plan.yaml
- test_higher_order_self_join.plan.yaml
- test_repartition.plan.yaml
- __init__.py
- test_cast_from_numeric.txt
- test_cast_from_string.txt
- test_cast_string_to_int.py
- test_cast_to_string.txt
- test_checkpoint.py
- test_col_regex.py
- test_column.py
- test_dataframe.py
- test_datetime.py
- test_fillna.txt
- test_group_by.py
- test_group_by_alias.txt
- test_higher_order_self_join.py
- test_identifier_clause.py
- test_input_files.py
- test_ipython_key_completions.txt
- test_join.txt
- test_join_using_coercion.py
- test_math.py
- test_math_interval_div.txt
- test_math_timestamp_add.txt
- test_order_by_aggregate.txt
- test_pivot.py
- test_repartition.py
- test_sample.py
- test_sample.txt
- test_sort.py
- test_sql.py
- test_table_function.py
- test_toddl.py
- test_udt.txt
- test_variant.py
- test_with_column.txt
- udt.py
- __init__.py
- conftest.py
- init.sql
- test_binary.py
- test_csv.py
- test_jdbc.py
- test_json.py
- test_mixed_directory.py
- test_mixed_directory.txt
- test_noop.py
- test_parquet.py
- test_python.py
- test_python_read.txt
- test_python_read_arrow.txt
- test_rate.py
- test_socket.py
- test_text.py
- test_vortex.py
- check_constraints.yaml
- checkpoint.yaml
- checksum.yaml
- column_mapping.yaml
- delete.yaml
- deletion_vectors.yaml
- generated_columns.yaml
- log_scan_parallel.yaml
- merge.yaml
- operation_metrics.yaml
- overwrite.yaml
- read_path.yaml
- v2_checkpoint.yaml
- variant.yaml
- alter_table.feature
- append_only.feature
- check_constraints.feature
- checkpoint.feature
- checkpoint_properties.feature
- checkpoint_stats_parsed.feature
- checksum.feature
- checksum_read.feature
- column_mapping.feature
- compacted_json.feature
- default_columns.feature
- delete.feature
- deletion_vectors.feature
- file_layout.feature
- generated_columns.feature
- identity_columns.feature
- log_scan_parallel.feature
- merge.feature
- operation_metrics.feature
- overwrite.feature
- partition_name_resolution.feature
- read_path.feature
- time_travel.feature
- timestamp_partition.feature
- v2_checkpoint.feature
- vacuum_protocol_check.feature
- variant.feature
- __init__.py
- conftest.py
- test_delta_advanced.py
- test_delta_checkpoint.py
- test_delta_column_mapping.py
- test_delta_column_mapping_delta_spark.py
- test_delta_column_mapping_rename_drop.py
- test_delta_concurrent.py
- test_delta_data_skipping.py
- test_delta_external_log_stats.py
- test_delta_features.py
- test_delta_generated_columns.py
- test_delta_io.py
- test_delta_merge_into_dataframe.py
- test_delta_metadata_only.py
- test_delta_partition_mismatch.py
- test_delta_partition_pruning.py
- test_delta_partitioning.py
- test_delta_schema_handling.py
- test_delta_user_metadata.py
- test_delta_variant.py
- test_delta_write_options.py
- explain_write.yaml
- create_table.feature
- create_table_as_select.feature
- create_table_partitioned.feature
- ctas_error_handling.feature
- explain_write.feature
- __init__.py
- test_features.py
- test_write_directory.py
- test_write_table.py
- explain.yaml
- lakehouse_commit.yaml
- scalar_subquery.yaml
- test_shuffle_storage.plan.yaml
- equivalence_properties.feature
- explain.feature
- lakehouse_commit.feature
- scalar_subquery.feature
- __init__.py
- conftest.py
- test_csv.py
- test_driver_server.py
- test_execution.py
- test_features.py
- test_shuffle.py
- test_shuffle_celeborn.py
- test_shuffle_storage.py
- query_result.feature
- last_day.yaml
- year.yaml
- variant_explode.yaml
- abs.yaml
- ceil_floor_preimage.yaml
- ceil_floor_simplify.yaml
- concat_simplify.yaml
- concat_ws_simplify.yaml
- bitmap_construct_agg.feature
- bitmap_or_agg.feature
- collect_list.feature
- count_distinct_star.feature
- count_if.feature
- first_last.feature
- grouping_id.feature
- input_order.feature
- max_by.feature
- min_by.feature
- mode.feature
- percentile.feature
- percentile_disc.feature
- product.feature
- sum.feature
- try_avg.feature
- try_sum.feature
- aggregate.feature
- array.feature
- array_append.feature
- array_coercion.feature
- array_compact.feature
- array_concat.feature
- array_contains.feature
- array_distinct.feature
- array_except.feature
- array_filter.feature
- array_insert.feature
- array_intersect.feature
- array_join.feature
- array_max.feature
- array_min.feature
- array_min_max.feature
- array_position.feature
- array_prepend.feature
- array_remove.feature
- array_repeat.feature
- array_sort.feature
- array_union.feature
- array_update.feature
- arrays_overlap.feature
- arrays_zip.feature
- exists.feature
- flatten.feature
- forall.feature
- get.feature
- sequence.feature
- shuffle.feature
- slice.feature
- sort_array.feature
- transform.feature
- bit_count.feature
- bit_get.feature
- getbit.feature
- shiftleft.feature
- shiftright.feature
- shiftrightunsigned.feature
- cardinality.feature
- concat.feature
- element_at.feature
- reverse.feature
- size.feature
- try_element_at.feature
- coalesce.feature
- if.feature
- ifnull.feature
- nanvl.feature
- nullif.feature
- nullifzero.feature
- nvl.feature
- nvl2.feature
- when.feature
- zeroifnull.feature
- cast.feature
- cast_date_to_numeric.feature
- cast_nan_inf.feature
- csv_options.feature
- from_csv.feature
- schema_of_csv.feature
- to_csv.feature
- convert_timezone.feature
- curdate.feature
- current_date.feature
- current_timezone.feature
- date_diff.feature
- date_format.feature
- date_from_unix_date.feature
- date_part.feature
- date_trunc.feature
- dateadd.feature
- datediff.feature
- datepart.feature
- datetime_edge_cases.feature
- datetime_format.feature
- datetime_literal.feature
- datetime_parse.feature
- day.feature
- dayname.feature
- dayofmonth.feature
- dayofyear.feature
- extract.feature
- from_unixtime.feature
- from_utc_timestamp.feature
- hour.feature
- interval_day_to_second.feature
- last_day.feature
- make_date.feature
- make_dt_interval.feature
- make_interval.feature
- make_timestamp.feature
- make_timestamp_ltz.feature
- make_ym_interval.feature
- minute.feature
- month.feature
- months_between.feature
- next_day.feature
- now.feature
- quarter.feature
- second.feature
- sequence_date.feature
- time_functions.feature
- time_type.feature
- timestampadd.feature
- timestampdiff.feature
- to_date.feature
- to_time.feature
- to_timestamp.feature
- to_timestamp_ntz.feature
- to_unix_timestamp.feature
- to_utc_timestamp.feature
- trunc.feature
- try_to_time.feature
- try_to_timestamp.feature
- unix_timestamp.feature
- weekday.feature
- window.feature
- window_time.feature
- year.feature
- variant_explode.feature
- crc32.feature
- hash.feature
- md5.feature
- sha.feature
- sha1.feature
- sha2.feature
- xxhash64.feature
- from_json.feature
- get_json_object.feature
- json_array_length.feature
- json_object_keys.feature
- json_tuple.feature
- schema_of_json.feature
- to_json.feature
- map.feature
- map_concat.feature
- map_contains_key.feature
- map_entries.feature
- map_from_arrays.feature
- map_from_entries.feature
- map_keys.feature
- map_values.feature
- str_to_map.feature
- abs.feature
- acos.feature
- acosh.feature
- asin.feature
- asinh.feature
- atan.feature
- atan2.feature
- atanh.feature
- bin.feature
- bround.feature
- cbrt.feature
- ceil.feature
- ceil_floor.feature
- ceil_floor_preimage.feature
- ceil_floor_simplify.feature
- ceiling.feature
- conv.feature
- cos.feature
- cosh.feature
- cot.feature
- csc.feature
- degrees.feature
- div.feature
- exp.feature
- expm1.feature
- factorial.feature
- floor.feature
- greatest.feature
- hex.feature
- hypot.feature
- least.feature
- ln.feature
- log.feature
- log10.feature
- log1p.feature
- log2.feature
- mod.feature
- negative.feature
- pmod.feature
- positive.feature
- pow.feature
- power.feature
- radians.feature
- rint.feature
- round.feature
- sec.feature
- sign.feature
- signum.feature
- sin.feature
- sinh.feature
- sqrt.feature
- tan.feature
- tanh.feature
- try_add.feature
- try_divide.feature
- try_mod.feature
- try_multiply.feature
- try_subtract.feature
- unhex.feature
- uniform.feature
- width_bucket.feature
- aes_decrypt.feature
- aes_encrypt.feature
- assert_true.feature
- bitmap_bit_position.feature
- bitmap_bucket_number.feature
- bitmap_count.feature
- current_catalog.feature
- current_database.feature
- current_schema.feature
- current_user.feature
- datasketches.feature
- raise_error.feature
- session_user.feature
- spark_partition_id.feature
- theta_sketch.feature
- try_aes_decrypt.feature
- typeof.feature
- user.feature
- uuid.feature
- version.feature
- equal_null.feature
- ilike.feature
- in.feature
- isnan.feature
- isnull.feature
- like.feature
- regexp.feature
- regexp_like.feature
- rlike.feature
- ascii.feature
- base64.feature
- bit_length.feature
- btrim.feature
- char.feature
- char_length.feature
- character_length.feature
- chr.feature
- concat_simplify.feature
- concat_ws.feature
- concat_ws_simplify.feature
- contains.feature
- decode.feature
- elt.feature
- encode.feature
- endswith.feature
- find_in_set.feature
- format_number.feature
- initcap.feature
- instr.feature
- is_valid_utf8.feature
- lcase.feature
- left.feature
- len.feature
- length.feature
- levenshtein.feature
- like_escape.feature
- locate.feature
- lower.feature
- lpad.feature
- ltrim.feature
- luhn_check.feature
- make_valid_utf8.feature
- mask.feature
- octet_length.feature
- overlay.feature
- position.feature
- quote.feature
- regexp_count.feature
- regexp_extract.feature
- regexp_extract_all.feature
- regexp_instr.feature
- regexp_replace.feature
- regexp_substr.feature
- repeat.feature
- replace.feature
- right.feature
- rpad.feature
- rtrim.feature
- sentences.feature
- soundex.feature
- space.feature
- split.feature
- split_part.feature
- startswith.feature
- substr.feature
- substring.feature
- substring_index.feature
- to_binary.feature
- to_char.feature
- to_number.feature
- to_varchar.feature
- translate.feature
- try_to_binary.feature
- try_to_number.feature
- try_validate_utf8.feature
- ucase.feature
- unbase64.feature
- upper.feature
- validate_utf8.feature
- named_struct.feature
- struct.feature
- struct_function.feature
- parse_url.feature
- try_parse_url.feature
- try_url_decode.feature
- url_decode.feature
- url_encode.feature
- cast_to_variant.feature
- is_variant_null.feature
- parse_json.feature
- schema_of_variant.feature
- schema_of_variant_agg.feature
- to_variant_object.feature
- try_parse_json.feature
- try_variant_get.feature
- variant.feature
- variant_get.feature
- vector_inner_product.feature
- array_join_window.feature
- ntile.feature
- percentile_window.feature
- window_collect_set.feature
- window_first_last.feature
- window_range_interval.feature
- window_skewness.feature
- from_xml.feature
- to_xml.feature
- xpath.feature
- xpath_boolean.feature
- xpath_double.feature
- xpath_float.feature
- xpath_int.feature
- xpath_long.feature
- xpath_number.feature
- xpath_short.feature
- xpath_string.feature
- xpath_typed.feature
- cte.feature
- divide_by_zero.feature
- identifier_clause.feature
- isin_subquery.feature
- null_literal_inference.feature
- pivot.feature
- regexp_replace.feature
- sample.feature
- semi_join.feature
- set_operations.feature
- table_function.feature
- tablesample.feature
- __init__.py
- test_convert_timezone.py
- test_explode.py
- test_features.py
- test_format_number.py
- test_format_string.py
- test_histogram_numeric.py
- test_input_order.py
- test_monotonically_increasing_id.py
- test_nullability_schema.py
- test_percentile_cont.py
- test_percentile_disc.py
- test_product.py
- test_quote.py
- test_randstr.py
- test_regexp_substr.py
- test_soundex.py
- test_spark_partition_id.py
- test_variant_explode.py
- explain.yaml
- io.yaml
- merge.yaml
- partition_transforms.yaml
- read_path.yaml
- variant.yaml
- alter_table.feature
- explain.feature
- io.feature
- merge.feature
- partition_transforms.feature
- partitioning.feature
- read_path.feature
- time_travel.feature
- variant.feature
- __init__.py
- conftest.py
- test_iceberg_complex_types.py
- test_iceberg_cross_compat.py
- test_iceberg_equality_delete.py
- test_iceberg_features.py
- test_iceberg_io.py
- test_iceberg_merge.py
- test_iceberg_partition_mismatch.py
- test_iceberg_partition_transforms.py
- test_iceberg_partitioned_reads.py
- test_iceberg_partitioned_writes.py
- test_iceberg_projection.py
- test_iceberg_pruning.py
- test_iceberg_reads.py
- test_iceberg_time_travel.py
- test_iceberg_write.py
- utils.py
- test_date.txt
- test_numeric.txt
- test_string_escape.txt
- test_timestamp.txt
- test_timestamp_ntz.txt
- test_timestamp_utc_timezone.txt
- test_unicode_escape.txt
- join_reorder_cartesian_product.feature
- join_reorder_expression_column_filter_dependency.feature
- join_reorder_hash_join_projection.feature
- join_reorder_inner_correctness.feature
- join_reorder_nested_complex_expr.feature
- join_reorder_theta_join_non_equi_filter.feature
- __init__.py
- test_features.py
- __init__.py
- test_heartbeat.py
- test_reattachable_execution.py
- __init__.py
- test_streaming_basic.py
- __init__.py
- test_arrow_agg_udf.txt
- test_arrow_cogrouped_map_udf.txt
- test_arrow_grouped_map_iter_udf.txt
- test_arrow_grouped_map_udf.txt
- test_arrow_map_udf.txt
- test_arrow_scalar_udf.txt
- test_arrow_udtf.txt
- test_pandas_agg_udf.txt
- test_pandas_agg_window.py
- test_pandas_cogrouped_map_udf.txt
- test_pandas_grouped_map_iter_udf.txt
- test_pandas_grouped_map_udf.txt
- test_pandas_map.py
- test_pandas_map_udf.txt
- test_pandas_scalar_udf.txt
- test_register_scalar_udf.txt
- test_register_udtf.txt
- test_scalar_udf.txt
- test_udf_casting.py
- __init__.py
- conftest.py
- test_basic.py
- test_clickbench.py
- test_config.py
- test_features.py
- test_tpcds.py
- test_tpch.py
- __init__.py
- conftest.py
- __init__.py
- __main__.py
- cli.py
- .dockerignore
- .editorconfig
- .gitattributes
- .gitignore
- .prettierignore
- Cargo.lock
- Cargo.toml
- clippy.toml
- CODE_OF_CONDUCT.md
- compose.yml
- CONTRIBUTING.md
- eslint.config.js
- LICENSE
- package.json
- pnpm-lock.yaml
- pyproject.toml
- README.md
# Installation Guide
1. Get the code
git clone https://github.com/lakehq/sail
Downloads the entire project code from GitHub to your computer.
cd sail
Moves into the project folder you just downloaded.
2. Official Install Script
Easy RecommendedPrerequisites
- Python 3 Python is required to use pip.
pip install pysail
Installs the package published on PyPI directly โ no need to clone the source.
pip install "pyspark-client"
Installs the package published on PyPI directly โ no need to clone the source.
After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.
Pulled directly from this repo's README.
3. Docker
EasyPrerequisites
- Git Needed to download the project code from GitHub.
- Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker compose up -d --build
Builds and starts all defined containers (server, database, etc.) at once, in the background.
Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.
4. Node.js
EasyPrerequisites
npm install
Downloads and installs the libraries listed in package.json.
npm start
Starts the development/run server.
After running the command, open the address shown in the terminal (usually something like http://localhost:3000) in your browser.
5. Python
EasyPrerequisites
pip install pysail
Installs the package published on PyPI directly โ no need to clone the source.
pip install "pyspark-client"
Installs the package published on PyPI directly โ no need to clone the source.
python -m pysail.examples.spark.compatibility_check <directory>
Runs the Python script (or module).
If it runs without errors and prints output in the terminal, it worked.
Pulled directly from this repo's README.
6. Rust
MediumPrerequisites
- Git Needed to download the project code from GitHub.
- Rust (rustup) Installing via rustup also installs cargo.
cargo build --release
Compiles the Rust project.
cargo run
Builds and then immediately runs the program.
If cargo build finishes without errors, it worked. The executable is created under target/.
// repository documentation
Was this content helpful?
(0 ratings)