delta-lake-internals
The Internals of Delta Lake
File Explorer
Download Latest Version (.zip)- deploying-to-github-pages.yml
- FUNDING.yml
- Action.md
- AddCDCFile.md
- AddFile.md
- CheckpointMetadata.md
- CheckpointOnlyAction.md
- CommitInfo.md
- DomainMetadata.md
- FileAction.md
- index.md
- Metadata.md
- Protocol.md
- RemoveFile.md
- SetTransaction.md
- SidecarFile.md
- SingleAction.md
- AppendOnlyTableFeature.md
- index.md
- AutoCompact.md
- AutoCompactBase.md
- AutoCompactRequest.md
- AutoCompactUtils.md
- index.md
- CatalogOwnedTableFeature.md
- CatalogOwnedTableUtils.md
- commits.md
- index.md
- CdcAddFileIndex.md
- CDCDataSpec.md
- CDCReader.md
- CDCReaderImpl.md
- CDCVersionDiffInfo.md
- ChangeDataFeedTableFeature.md
- DeltaCDFRelation.md
- DeltaSourceCDCSupport.md
- index.md
- IndexedChangeFileSeq.md
- TahoeChangeFileIndex.md
- TahoeRemoveFileIndex.md
- AddConstraint.md
- AlterTableAddConstraint.md
- AlterTableDropConstraint.md
- CheckConstraintsTableFeature.md
- DropConstraint.md
- index.md
- CheckpointHook.md
- Checkpoints.md
- CheckpointV2.md
- index.md
- index.md
- Invariants.md
- InvariantsTableFeature.md
- ColumnMappingTableFeature.md
- DeltaColumnMappingBase.md
- DeltaColumnMappingMode.md
- index.md
- index.md
- AlterDeltaTableCommand.md
- AlterTableAddColumnsDeltaCommand.md
- AlterTableAddConstraintDeltaCommand.md
- AlterTableChangeColumnDeltaCommand.md
- AlterTableClusterByDeltaCommand.md
- AlterTableConstraintDeltaCommand.md
- AlterTableDropColumnsDeltaCommand.md
- AlterTableDropConstraintDeltaCommand.md
- AlterTableDropFeature.md
- AlterTableDropFeatureDeltaCommand.md
- AlterTableReplaceColumnsDeltaCommand.md
- AlterTableSetLocationDeltaCommand.md
- AlterTableSetPropertiesDeltaCommand.md
- AlterTableUnsetPropertiesDeltaCommand.md
- DropFeature.md
- index.md
- RemoveColumnMappingCommand.md
- CloneConvertedSource.md
- CloneDeltaSource.md
- CloneParquetSource.md
- CloneSource.md
- CloneTableBase.md
- CloneTableBaseUtils.md
- CloneTableCommand.md
- CloneTableStatement.md
- index.md
- ConvertTargetTable.md
- ConvertToDeltaCommand.md
- ConvertToDeltaCommandUtils.md
- DeltaConvert.md
- FileManifest.md
- index.md
- ManualListingFileManifest.md
- MetadataLogFileManifest.md
- ParquetTable.md
- CreateDeltaTableCommand.md
- CreateDeltaTableLike.md
- index.md
- DeleteCommand.md
- DeleteCommandMetrics.md
- DeltaDelete.md
- index.md
- DescribeDeltaDetailCommand.md
- index.md
- TableDetail.md
- DeltaHistory.md
- DescribeDeltaHistory.md
- DescribeDeltaHistoryCommand.md
- index.md
- DeltaGenerateCommand.md
- index.md
- ClassicMergeExecutor.md
- DeduplicateCDFDeletes.md
- DeltaMergeAction.md
- DeltaMergeBuilder.md
- DeltaMergeInto.md
- DeltaMergeIntoClause.md
- DeltaMergeIntoMatchedClause.md
- DeltaMergeIntoMatchedDeleteClause.md
- DeltaMergeIntoMatchedUpdateClause.md
- DeltaMergeIntoNotMatchedBySourceClause.md
- DeltaMergeIntoNotMatchedBySourceDeleteClause.md
- DeltaMergeIntoNotMatchedBySourceUpdateClause.md
- DeltaMergeIntoNotMatchedClause.md
- DeltaMergeIntoNotMatchedInsertClause.md
- DeltaMergeMatchedActionBuilder.md
- DeltaMergeNotMatchedActionBuilder.md
- DeltaMergeNotMatchedBySourceActionBuilder.md
- index.md
- InsertOnlyMergeExecutor.md
- JoinedRowProcessor.md
- MergeIntoCommand.md
- MergeIntoCommandBase.md
- MergeIntoMaterializeSource.md
- MergeOutputGeneration.md
- MergeStats.md
- DeltaOptimizeContext.md
- HilbertByteArrayIndex.md
- HilbertClustering.md
- HilbertLongIndex.md
- index.md
- InterleaveBits.md
- MultiDimClustering.md
- MultiDimClusteringFunctions.md
- OptimizeExecutor.md
- OptimizeMetrics.md
- OptimizeStats.md
- OptimizeTableCommand.md
- OptimizeTableCommandBase.md
- PartitionerExpr.md
- RangePartitionId.md
- RangePartitionIdRewrite.md
- SpaceFillingCurveClustering.md
- ZOrderClustering.md
- DeltaReorgTable.md
- DeltaReorgTableCommand.md
- index.md
- ReorgTableForUpgradeUniformHelper.md
- index.md
- RestoreTableCommand.md
- RestoreTableCommandBase.md
- RestoreTableStatement.md
- TimeTravel.md
- index.md
- ShowDeltaTableColumnsCommand.md
- DeltaUpdateTable.md
- index.md
- UpdateCommand.md
- index.md
- VacuumCommand.md
- VacuumCommandImpl.md
- VacuumTableCommand.md
- DeltaCommand.md
- index.md
- WriteIntoDelta.md
- WriteIntoDeltaLike.md
- DeltaSQLConf.md
- index.md
- Check.md
- CheckDeltaInvariant.md
- Constraint.md
- Constraints.md
- DeltaInvariantChecker.md
- DeltaInvariantCheckerExec.md
- DeltaInvariantCheckerStrategy.md
- index.md
- Invariant.md
- InvariantViolationException.md
- index.md
- CommitCoordinatorBuilder.md
- CommitCoordinatorClient.md
- CommitCoordinatorProvider.md
- CoordinatedCommitsPreDowngradeCommand.md
- CoordinatedCommitsTableFeature.md
- CoordinatedCommitsUtils.md
- DeltaCommitFileProvider.md
- index.md
- TableCommitCoordinatorClient.md
- index.md
- ColumnPredicateBuilder.md
- CountStarDeltaTable.md
- DataFiltersBuilder.md
- DataSkippingPredicateBuilder.md
- DataSkippingReaderBase.md
- DeltaDataSkippingType.md
- DeltaScan.md
- DeltaScanGenerator.md
- FileSizeHistogram.md
- index.md
- OptimizeMetadataOnlyDeltaQuery.md
- PreparedDeltaFileIndex.md
- PrepareDeltaScan.md
- PrepareDeltaScanBase.md
- ReadsMetadataFields.md
- ShowCountStarDeltaTable.md
- StatsProvider.md
- UsesMetadataFields.md
- DeletionVectorBitmapGenerator.md
- DeletionVectorDescriptor.md
- DeletionVectorSet.md
- DeletionVectorsPreDowngradeCommand.md
- DeletionVectorsTableFeature.md
- DeletionVectorStore.md
- DeletionVectorStoredBitmap.md
- DeletionVectorStoreUtils.md
- DeletionVectorUtils.md
- DeletionVectorWriter.md
- DMLWithDeletionVectorsHelper.md
- HadoopFileSystemDVStore.md
- index.md
- PreprocessTableWithDVsStrategy.md
- RowIndexFilter.md
- RowIndexMarkingFilters.md
- RowIndexMarkingFiltersBuilder.md
- ScanWithDeletionVectors.md
- StoredBitmap.md
- TouchedFileWithDV.md
- catalog-managed-tables-unity-catalog.md
- change-data-feed.md
- column-mapping.md
- Converting-Parquet-Dataset-Into-Delta-Format.md
- data-skipping.md
- dataChange.md
- Debugging-Delta-Lake-Using-IntelliJ-IDEA.md
- DeltaTable-DeltaLog-And-Snapshots.md
- generated-columns.md
- index.md
- merge-operation.md
- Observing-Transaction-Retries.md
- optimize.md
- replaceWhere.md
- rolling-back-table-changes-restore-command.md
- schema-evolution.md
- stream-processing-of-delta-table.md
- time-travel.md
- user-metadata-for-labelling-commits.md
- Using-Delta-Lake-as-Streaming-Sink-in-Structured-Streaming.md
- vacuum.md
- DeltaDynamicPartitionOverwriteCommand.md
- index.md
- ConcurrentAppendException.md
- ConcurrentDeleteDeleteException.md
- ConcurrentDeleteReadException.md
- ConcurrentTransactionException.md
- ConcurrentWriteException.md
- DeltaConcurrentModificationException.md
- index.md
- MetadataChangedException.md
- ProtocolChangedException.md
- index.md
- GeneratedColumn.md
- GeneratedColumnsTableFeature.md
- index.md
- GenerateIdentityValues.md
- IdentityColumn.md
- IdentityColumnsTableFeature.md
- index.md
- PartitionIdentityValueGenerator.md
- cdf-metadata-columns.png
- demo-remote-jvm.png
- demo-snapshot-webui-storage.png
- Snapshot-computedState-webui-query-details.png
- DefaultEngine.md
- Engine.md
- FileSystemClient.md
- index.md
- SnapshotImpl.md
- Table.md
- TableImpl.md
- index.md
- ClusterByParserUtils.md
- ClusterByPlan.md
- ClusterBySpec.md
- ClusteredTableUtilsBase.md
- ClusteringMetadataDomain.md
- ClusteringTableFeature.md
- index.md
- JsonMetadataDomainUtils.md
- index.md
- MetadataCleanup.md
- GenerateSymlinkManifest.md
- index.md
- PostCommitHook.md
- UpdateCatalogBase.md
- DefaultRowCommitVersion.md
- DeltaScanWithRowTrackingEnabled.md
- GenerateRowIDs.md
- index.md
- MaterializedRowCommitVersion.md
- MaterializedRowTrackingColumn.md
- MetadataStructField.md
- RowCommitVersion.md
- RowId.md
- RowTracking.md
- RowTrackingBackfillCommand.md
- RowTrackingFeature.md
- AdmissionLimits.md
- DeltaDataSource.md
- DeltaOptionParser.md
- DeltaOptions.md
- DeltaReadOptions.md
- DeltaSink.md
- DeltaSource.md
- DeltaSourceBase.md
- DeltaSourceMetadataEvolutionSupport.md
- DeltaSourceMetadataTrackingLog.md
- DeltaSourceOffset.md
- DeltaSourceSnapshot.md
- DeltaSourceUtils.md
- DeltaWriteOptions.md
- DeltaWriteOptionsImpl.md
- index.md
- options.md
- PersistedMetadata.md
- ProtocolMetadataAdapterV1.md
- SchemaReadOptions.md
- SchemaTrackingLog.md
- SnapshotIterator.md
- SparkBatch.md
- SparkMicroBatchStream.md
- SparkScan.md
- DeltaParquetFileFormatV2.md
- index.md
- PartitionUtils.md
- ProtocolMetadataAdapterV2.md
- SparkTable.md
- DeltaSqlAstBuilder.md
- DeltaSqlParser.md
- index.md
- DelegatingLogStore.md
- HadoopFileSystemLogStore.md
- HDFSLogStore.md
- index.md
- LogStore.md
- LogStoreAdaptor.md
- LogStoreProvider.md
- S3SingleDriverLogStore.md
- DomainMetadataTableFeature.md
- FeatureAutomaticallyEnabledByMetadata.md
- InCommitTimestampTableFeature.md
- index.md
- LegacyWriterFeature.md
- PreDowngradeTableFeatureCommand.md
- ReaderWriterFeature.md
- ReaderWriterFeatureType.md
- RemovableFeature.md
- TableFeature.md
- TableFeatureProtocolUtils.md
- TableFeatureSupport.md
- VacuumProtocolCheckTableFeature.md
- VariantTypePreviewTableFeature.md
- VariantTypeTableFeature.md
- WriterFeature.md
- DeltaConfig.md
- DeltaConfigs.md
- index.md
- DeltaTableValueFunction.md
- DeltaTableValueFunctions.md
- index.md
- DeltaTimeTravelSpec.md
- index.md
- HudiConverter.md
- HudiConverterHook.md
- IcebergCompat.md
- IcebergCompatV2.md
- IcebergConverter.md
- IcebergConverterHook.md
- index.md
- UniversalFormat.md
- UniversalFormatConverter.md
- index.md
- UCCatalogManagedClient.md
- UCCatalogManagedCommitter.md
- UCClient.md
- UCClientFactory.md
- UCCommitCoordinatorBuilder.md
- UCCommitCoordinatorClient.md
- UCTokenBasedRestClient.md
- UCTokenBasedRestClientFactory.md
- UpdateMetricsHook.md
- ChecksumHook.md
- index.md
- RecordChecksum.md
- WriteChecksum.md
- .nav.yml
- AbstractDeltaCatalog.md
- AppendDelta.md
- ApplyV2Streaming.md
- CachedDS.md
- CheckpointFileManager.md
- CheckUnresolvedRelationTimeTravel.md
- ColumnMappingPreDowngradeCommand.md
- ColumnWithDefaultExprUtils.md
- ConflictChecker.md
- CurrentTransactionInfo.md
- DelayedCommitProtocol.md
- DeltaAnalysis.md
- DeltaAnalysisException.md
- DeltaCatalog.md
- DeltaColumnBuilder.md
- DeltaErrors.md
- DeltaErrorsBase.md
- DeltaFileFormat.md
- DeltaFileFormatWriter.md
- DeltaFileOperations.md
- DeltaHistoryManager.md
- DeltaJobStatisticsTracker.md
- DeltaLog.md
- DeltaLogFileIndex.md
- DeltaLogging.md
- DeltaOptimizeBuilder.md
- DeltaOptimizedWriterExec.md
- DeltaParquetFileFormat.md
- DeltaParquetFileFormatBase.md
- DeltaProgressReporter.md
- DeltaRelation.md
- DeltaSparkSessionExtension.md
- DeltaTable.md
- DeltaTableBuilder.md
- DeltaTableIdentifier.md
- DeltaTableOperations.md
- DeltaTableUtils.md
- DeltaTableV2.md
- DeltaUnsupportedOperationsCheck.md
- DeltaV1WriteBuilder.md
- DeltaV2Mode.md
- developer-api.md
- DomainMetadataUtils.md
- FileNames.md
- ImplicitMetadataOperation.md
- index.md
- InitialSnapshot.md
- InMemoryLogReplay.md
- installation.md
- IsolationLevel.md
- JsonMetadataDomain.md
- logging.md
- LogSegment.md
- LogStore.md
- Operation.md
- OptimisticTransaction.md
- OptimisticTransactionImpl.md
- PartitionFiltering.md
- PostHocResolveUpCast.md
- PreprocessTableDelete.md
- PreprocessTableMerge.md
- PreprocessTableUpdate.md
- PreprocessTimeTravel.md
- ProtocolMetadataAdapter.md
- ReadChecksum.md
- ResolveDeltaPathTable.md
- SchemaMergingUtils.md
- SchemaUtils.md
- Snapshot.md
- SnapshotDescriptor.md
- SnapshotManagement.md
- SnapshotStateManager.md
- SQLMetricsReporting.md
- StagedDeltaTableV2.md
- State.md
- StateCache.md
- StatisticsCollection.md
- SupportsPathIdentifier.md
- SupportsRowIndexFilters.md
- TahoeBatchFileIndex.md
- TahoeFileIndex.md
- TahoeFileIndexWithSnapshotDescriptor.md
- TahoeLogFileIndex.md
- TransactionalWrite.md
- TransactionHelper.md
- VerifyChecksum.md
- WriteIntoDeltaBuilder.md
- .gitignore
- LICENSE
- mkdocs.yml
- README.md
- requirements.txt
// repository documentation
Was this content helpful?
(0 ratings)