incubator-xtable
Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.
파일 탐색기
최종 버전 다운로드 (.zip)- config.yml
- xtable_bug_report.yml
- xtable_improvement_feature.yml
- commit_coauthor_validation.yml
- mvn-ci-build.yml
- mvn-license-check.yml
- package-deploy.yml
- pr_title_validation.yml
- site-build.yml
- site-deploy.yml
- source-build-check.yml
- dependabot.yml
- PULL_REQUEST_TEMPLATE.md
- maven-wrapper.properties
- extensions.xml
- maven-build-cache-config.xml
- maven.config
- catalog_sync_flow.jpg
- sync_flow.jpg
- 00000000000000000000.json
- part-00000-6ccb71bc-9cc1-4226-a7b5-f752edbedee6-c000.snappy.parquet
- 00000000000000010.deltacommit
- 00000000000000010.deltacommit.inflight
- 00000000000000010.deltacommit.requested
- 20231105172136406.deltacommit
- 20231105172136406.deltacommit.inflight
- 20231105172136406.deltacommit.requested
- hoodie.properties
- .files-0000-0_00000000000000010.log.1_0-0-0
- .files-0000-0_00000000000000010.log.2_0-87-178
- .hoodie_partition_metadata
- files-0000-0_0-73-165_00000000000000010.hfile
- 20231105172136406.commit
- 20231105172136406.commit.requested
- 20231105172136406.inflight
- hoodie.properties
- .hoodie_partition_metadata
- b1ee44c7-255b-47bf-b788-1e7017790326-0_0-80-172_20231105172136406.parquet
- DimCustomer_round2.csv
- Dockerfile
- predef.sc
- prefetch_dependencies.sh
- verify_dependencies.sh
- demo.ipynb
- delta.properties
- hive.properties
- hudi.properties
- iceberg.properties
- config.properties
- jvm.config
- log.properties
- node.properties
- delta.properties
- hive.properties
- iceberg.properties
- .dockerignore
- build_demo.sh
- docker-compose.yaml
- README.md
- start_demo.sh
- stop_demo.sh
- create_source_release.sh
- cut_release_branch.sh
- deploy_staging_jars.sh
- generate_shaded_license_metadata.py
- validate_bundled_license_texts.py
- validate_shaded_license_coverage.sh
- validate_source_binary_files.sh
- validate_source_copyright.sh
- validate_source_rat.sh
- validate_staged_bundles.sh
- validate_staged_release.sh
- release_guide.md
- rfc-1.md
- 2 - Deletion Info Conversion.md
- template.md
- Makefile
- README.md
- requirements.txt
- rest-service-open-api.yaml
- IDE.png
- license-header
- text-license-header
- xml-license-header
- announcing-onetable.mdx
- aws-mwaa.mdx
- breaking-data-silos.mdx
- ecommerce-funnel-analysis-with-starrocks.mdx
- ext-blog-minio.mdx
- ext-blog-naren.mdx
- ext-blog-oh.mdx
- interop-lakehouse.mdx
- microsoft_fabric.mdx
- multi-cat-sync.mdx
- onetable-intro-dip.mdx
- OneTable-is-now-Apache-XTable.md
- onetable-launch.mdx
- onetable-now-oss.mdx
- road-to-interoperable-lakehouse.mdx
- siliconangle-onetable.mdx
- soumil_sync.mdx
- xtable-databricks.mdx
- xtable-iceberg-fs-catalog.mdx
- xtable-in-aws-lambda.mdx
- xtable-unity.mdx
- becoming-a-committer.md
- sync.md
- docker.md
- athena.md
- biglake-metastore.md
- bigquery.md
- catalogs-index.md
- fabric.md
- features-and-limitations.md
- glue-catalog.md
- hms.md
- how-to-catalog-sync.md
- how-to.md
- integrations-index.md
- presto.md
- query-engines-index.md
- redshift.md
- setup.md
- snowflake.md
- spark.md
- starrocks.md
- trino.md
- unity-catalog.md
- 404.html
- index.html
- downloads.mdx
- release-0.2.0-incubating.mdx
- release-0.3.0-incubating.mdx
- styles.module.css
- Redirect.js
- custom.css
- index.module.css
- markdown-page.md
- index.js
- index.js
- index.js
- index.js
- index.js
- styles.module.css
- index.js
- index.js
- styles.module.css
- index.js
- styles.module.css
- index.js
- styles.module.css
- index.js
- index.js
- normalize.css
- onetable-ad267e.webflow.css
- webflow.css
- Ranade-Bold.otf
- Ranade-BoldItalic.otf
- Ranade-Italic.otf
- Ranade-Light.otf
- Ranade-LightItalic.otf
- Ranade-Medium.otf
- Ranade-MediumItalic.otf
- Ranade-Regular.otf
- Ranade-Thin.otf
- Ranade-ThinItalic.otf
- announcing-onetable.png
- aws_mwaa.jpg
- starrocks-xtable.png
- omni-dir.png
- ice-fs.jpg
- iceberg-shortcut-diagram-1024x576-3.png
- onetable-intro-dip.png
- Onetable_thumb.png
- onetable-cover.png
- onetable-now-oss.png
- road-to-interoperable-lakehouse.png
- onetable-sa.png
- 1732278614623.png
- xtable-cover.png
- xtable-docs.png
- xtable-github.png
- xtable-db-use.jpg
- xtable-in-aws-lambda.png
- xtable_unity.jpg
- cat-1200x600.jpg
- xt-feb.png
- xt-nov.png
- xt-oh.png
- shortcut_1_1.png
- shortcut_1_2.png
- shortcut_1_3.png
- shortcut_1_4.png
- shortcut_1_5.png
- Apache-Hudi.png
- break.svg
- Delta-lake.png
- destination-1.png
- Github.svg
- GR-BG1.svg
- GR-BGR.svg
- Iceberg.png
- linkedin.svg
- metadata-1.png
- page-not-found.svg
- source-2.png
- together-p-500.png
- together.png
- twitter.svg
- xtable-favicon.png
- xtable-hero.svg
- xtable-icon.png
- xtable-white.png
- xtable-words-white.png
- xtable-write-anywhere.png
- jquery-3.5.1.min.js
- webflow.js
- .asf.yaml
- .htaccess
- .nojekyll
- CNAME
- .gitignore
- babel.config.js
- docusaurus.config.js
- package-lock.json
- package.json
- README.md
- sidebars.js
- Evolving.java
- Stable.java
- CatalogConfig.java
- ConversionConfig.java
- ExternalCatalogConfig.java
- ExternalTable.java
- SourceTable.java
- TargetCatalogConfig.java
- TargetTable.java
- CatalogTableIdentifier.java
- HierarchicalTableIdentifier.java
- ThreePartHierarchicalTableIdentifier.java
- CatalogRefreshException.java
- ErrorCode.java
- InternalException.java
- ParseException.java
- TableSyncMetadata.java
- InternalField.java
- InternalPartitionField.java
- InternalSchema.java
- InternalType.java
- PartitionFieldSpec.java
- PartitionTransformType.java
- ColumnStat.java
- FileStats.java
- PartitionValue.java
- Range.java
- CatalogType.java
- DataLayoutStrategy.java
- FileFormat.java
- FilesDiff.java
- InternalDataFile.java
- InternalFile.java
- InternalFilesDiff.java
- PartitionFileGroup.java
- TableFormat.java
- ErrorDetails.java
- SyncMode.java
- SyncResult.java
- SyncStatusCode.java
- ValidationCheck.java
- ValidationChecker.java
- ValidationResult.java
- CommitsBacklog.java
- IncrementalTableChanges.java
- InstantsForIncrementalSync.java
- InternalSnapshot.java
- InternalTable.java
- TableChange.java
- CatalogConversionSource.java
- ChangesExtractor.java
- ConversionSource.java
- DataFileIterator.java
- ExtractFromSource.java
- SchemaExtractor.java
- SnapshotExtractor.java
- SourcePartitionSpecExtractor.java
- TableExtractor.java
- CatalogSync.java
- CatalogSyncClient.java
- CatalogUtils.java
- ConversionTarget.java
- TableFormatSync.java
- TestExternalTable.java
- TestSourceTable.java
- TestTargetTable.java
- TestThreePartHierarchicalTableIdentifier.java
- TestTableSyncMetadata.java
- TestDataFilesDiff.java
- TestFilesDiff.java
- TestExtractFromSource.java
- TestCatalogSync.java
- TestCatalogUtils.java
- TestTableFormatSync.java
- pom.xml
- DeltaGlueCatalogTableBuilder.java
- HudiGlueCatalogTableBuilder.java
- IcebergGlueCatalogTableBuilder.java
- DefaultGlueClientFactory.java
- GlueCatalogConfig.java
- GlueCatalogConversionSource.java
- GlueCatalogPartitionSyncOperations.java
- GlueCatalogSyncClient.java
- GlueCatalogTableBuilderFactory.java
- GlueCatalogTableUtils.java
- GlueClientFactory.java
- GlueSchemaExtractor.java
- LICENSE-checker-qual
- LICENSE-javax.annotation-api
- LICENSE-paranamer
- LICENSE-reactive-streams
- LICENSE-zstd-jni
- org.apache.xtable.spi.extractor.CatalogConversionSource
- org.apache.xtable.spi.sync.CatalogSyncClient
- LICENSE-bundled
- NOTICE-bundled
- TestDeltaGlueCatalogTableBuilder.java
- TestHudiGlueCatalogTableBuilder.java
- TestIcebergGlueCatalogTableBuilder.java
- GlueCatalogSyncTestBase.java
- TestGlueCatalogConfig.java
- TestGlueCatalogConversionSource.java
- TestGlueCatalogPartitionSyncOperations.java
- TestGlueCatalogSyncClient.java
- TestGlueSchemaExtractor.java
- pom.xml
- XTableValueMetadata.java
- AvroSchemaConverter.java
- CatalogConversionFactory.java
- CatalogPartition.java
- CatalogPartitionEvent.java
- CatalogPartitionSyncOperations.java
- CatalogPartitionSyncTool.java
- CatalogTableBuilder.java
- CatalogUtils.java
- Constants.java
- TableFormatUtils.java
- CustomCollectors.java
- ConversionController.java
- ConversionSourceProvider.java
- ConversionTargetFactory.java
- ConversionUtils.java
- DeltaActionsConverter.java
- DeltaConversionSource.java
- DeltaConversionSourceConfig.java
- DeltaConversionSourceProvider.java
- DeltaConversionTarget.java
- DeltaConversionTargetConfig.java
- DeltaConversionUtils.java
- DeltaDataFileExtractor.java
- DeltaDataFileUpdatesExtractor.java
- DeltaIncrementalChangesState.java
- DeltaPartitionExtractor.java
- DeltaSchemaExtractor.java
- DeltaStatsExtractor.java
- DeltaStatsUtils.java
- DeltaTableExtractor.java
- DeltaValueConverter.java
- ScalaUtils.java
- CatalogSyncException.java
- ConfigurationException.java
- NotSupportedException.java
- PartitionSpecException.java
- PartitionValuesExtractorException.java
- ReadException.java
- SchemaExtractorException.java
- UnsupportedSchemaTypeException.java
- UpdateException.java
- HudiCatalogPartitionSyncTool.java
- HudiCatalogTablePropertiesExtractor.java
- HudiInputFormatUtils.java
- BaseFileUpdatesExtractor.java
- ConfigurationBasedPartitionSpecExtractor.java
- HudiConversionSource.java
- HudiConversionSourceProvider.java
- HudiConversionTarget.java
- HudiDataFileExtractor.java
- HudiFileStats.java
- HudiFileStatsExtractor.java
- HudiInstantUtils.java
- HudiPathUtils.java
- HudiSchemaExtractor.java
- HudiSourceConfig.java
- HudiTableExtractor.java
- HudiTableManager.java
- PathBasedPartitionSpecExtractor.java
- PathBasedPartitionValuesExtractor.java
- IcebergCatalogConfig.java
- IcebergColumnStatsConverter.java
- IcebergConversionSource.java
- IcebergConversionSourceProvider.java
- IcebergConversionTarget.java
- IcebergDataFileExtractor.java
- IcebergDataFileUpdatesSync.java
- IcebergPartitionSpecExtractor.java
- IcebergPartitionSpecSync.java
- IcebergPartitionValueConverter.java
- IcebergPartitionValueExtractor.java
- IcebergSchemaExtractor.java
- IcebergSchemaSync.java
- IcebergTableManager.java
- DeltaKernelActionsConverter.java
- DeltaKernelConversionSource.java
- DeltaKernelConversionSourceProvider.java
- DeltaKernelConversionTarget.java
- DeltaKernelDataFileExtractor.java
- DeltaKernelDataFileUpdatesExtractor.java
- DeltaKernelIncrementalChangesState.java
- DeltaKernelPartitionExtractor.java
- DeltaKernelSchemaExtractor.java
- DeltaKernelStatsExtractor.java
- DeltaKernelTableExtractor.java
- DeltaKernelUtils.java
- PaimonConversionSource.java
- PaimonConversionSourceProvider.java
- PaimonDataFileExtractor.java
- PaimonPartitionExtractor.java
- PaimonSchemaExtractor.java
- PaimonStatsExtractor.java
- ParquetConversionSource.java
- ParquetConversionSourceProvider.java
- ParquetDataManager.java
- ParquetFileInfo.java
- ParquetMetadataExtractor.java
- ParquetPartitionSpecExtractor.java
- ParquetPartitionValueExtractor.java
- ParquetSchemaExtractor.java
- ParquetSourceConfig.java
- ParquetStatsExtractor.java
- PathUtils.java
- ReflectionUtils.java
- SchemaFieldFinder.java
- SchemaUtils.java
- SparkSchemaExtractor.java
- org.apache.xtable.spi.sync.ConversionTarget
- TestXTableValueMetadata.java
- TestAvroSchemaConverter.java
- TestCatalogConversionFactory.java
- TestCatalogUtils.java
- TestSchemaExtractorBase.java
- TestTableFormatUtils.java
- TestConversionConfig.java
- TestConversionController.java
- TestConversionTargetFactory.java
- ITDeltaConversionSource.java
- ITDeltaDeleteVectorConvert.java
- TestDeltaActionsConverter.java
- TestDeltaConversionSourceConfig.java
- TestDeltaHelper.java
- TestDeltaPartitionExtractor.java
- TestDeltaSchemaExtractor.java
- TestDeltaStatsExtractor.java
- TestDeltaSync.java
- TestDeltaValueConverter.java
- TestHudiCatalogPartitionSyncTool.java
- TestHudiCatalogTablePropertiesExtractor.java
- TestHudiInputFormatUtils.java
- HudiTestUtil.java
- ITHudiConversionSource.java
- ITHudiConversionTarget.java
- TestBaseFileUpdatesExtractor.java
- TestHudiConversionSource.java
- TestHudiConversionTarget.java
- TestHudiFileStatsExtractor.java
- TestHudiInstantUtils.java
- TestHudiPartitionValuesExtractor.java
- TestHudiSchemaExtractor.java
- TestHudiTableManager.java
- IcebergTestUtils.java
- ITIcebergConversionSource.java
- StubCatalog.java
- TestIcebergColumnStatsConverter.java
- TestIcebergConversionSource.java
- TestIcebergDataHelper.java
- TestIcebergPartitionSpecExtractor.java
- TestIcebergPartitionSpecSync.java
- TestIcebergPartitionValueConverter.java
- TestIcebergSchemaExtractor.java
- TestIcebergSchemaSync.java
- TestIcebergSync.java
- TestIcebergTableManager.java
- ITDeltaKernelConversionSource.java
- TestDeltaKernelDataFileUpdatesExtractor.java
- TestDeltaKernelPartitionExtractor.java
- TestDeltaKernelReadWriteIntegration.java
- TestDeltaKernelSchemaExtractor.java
- TestDeltaKernelStatsExtractor.java
- TestDeltaKernelSync.java
- LoadTest.java
- TestPaimonConversionSource.java
- TestPaimonDataFileExtractor.java
- TestPaimonPartitionExtractor.java
- TestPaimonSchemaExtractor.java
- TestPaimonStatsExtractor.java
- ITParquetConversionSource.java
- TestParquetDataManager.java
- TestParquetSchemaExtractor.java
- TestParquetStatsExtractor.java
- TestSparkParquetTable.java
- TestPathUtils.java
- TestSparkSchemaExtractor.java
- ColumnStatMapUtil.java
- Issues.java
- ITTestUtils.java
- GenericTable.java
- ITConversionController.java
- TestAbstractHudiTable.java
- TestIcebergTable.java
- TestJavaHudiTable.java
- TestPaimonTable.java
- TestSparkDeltaTable.java
- TestSparkHudiTable.java
- ValidationTestHelper.java
- org.apache.xtable.spi.extractor.CatalogConversionSource
- org.apache.xtable.spi.sync.CatalogSyncClient
- catalog_sales.json
- basic_schema.avsc
- catalog_sales.json
- junit-platform.properties
- log4j2.xml
- pom.xml
- DeltaHMSCatalogTableBuilder.java
- HudiHMSCatalogTableBuilder.java
- IcebergHMSCatalogTableBuilder.java
- HMSCatalogConfig.java
- HMSCatalogConversionSource.java
- HMSCatalogPartitionSyncOperations.java
- HMSCatalogSyncClient.java
- HMSCatalogTableBuilderFactory.java
- HMSClientProvider.java
- HMSSchemaExtractor.java
- LICENSE-antlr-runtime
- LICENSE-aopalliance
- LICENSE-checker-qual
- LICENSE-hamcrest-core
- LICENSE-jamon-runtime
- LICENSE-javax.annotation-api
- LICENSE-javolution
- LICENSE-jcodings
- LICENSE-jersey-client
- LICENSE-jersey-guice
- LICENSE-jersey-json
- LICENSE-jline
- LICENSE-joni
- LICENSE-jta
- LICENSE-junit
- LICENSE-leveldbjni-all
- LICENSE-paranamer
- LICENSE-protobuf-java
- LICENSE-ST4
- LICENSE-transaction-api
- LICENSE-xmlenc
- LICENSE-zstd-jni
- org.apache.xtable.spi.extractor.CatalogConversionSource
- org.apache.xtable.spi.sync.CatalogSyncClient
- LICENSE-bundled
- NOTICE-bundled
- TestDeltaHMSCatalogTableBuilder.java
- TestHudiHMSCatalogTableBuilder.java
- TestIcebergHMSCatalogTableBuilder.java
- HMSCatalogSyncTestBase.java
- TestHMSCatalogConfig.java
- TestHMSCatalogConversionSource.java
- TestHMSCatalogPartitionSyncOperations.java
- TestHMSCatalogSyncClient.java
- TestHMSCatalogTableBuilderFactory.java
- TestHMSSchemaExtractor.java
- pom.xml
- AddFieldIdsClientInitCallback.java
- HoodieAvroWriteSupportWithFieldIds.java
- XTableSyncConfig.java
- XTableSyncTool.java
- LICENSE-checker-qual
- LICENSE-paranamer
- LICENSE-slf4j-api
- LICENSE-bundled
- NOTICE-bundled
- TestAddFieldIdsClientInitCallback.java
- TestXTableSyncTool.java
- junit-platform.properties
- pom.xml
- README.md
- IdMapping.java
- IdTracking.java
- IdTracker.java
- TestIdTracker.java
- junit-platform.properties
- pom.xml
- pom.xml
- Screenshot 2025-05-01 at 9.04.59 AM.png
- Screenshot 2025-05-01 at 9.05.10 AM.png
- ConvertedTable.java
- ConvertTableRequest.java
- ConvertTableResponse.java
- ConversionResource.java
- ConversionService.java
- ConversionServiceConfig.java
- application.properties
- xtable-hadoop-defaults.xml
- ITConversionService.java
- TestConversionResource.java
- TestConversionService.java
- application.properties
- pom.xml
- README.md
- RunCatalogSync.java
- RunSync.java
- log4j2.xml
- xtable-conversion-defaults.yaml
- xtable-hadoop-defaults.xml
- ITRunCatalogSync.java
- ITRunSync.java
- TestRunCatalogSync.java
- TestRunSync.java
- catalogConfig.yaml
- my_config.yaml
- pom.xml
- .asf.yaml
- .gitignore
- AGENTS.md
- DISCLAIMER-WIP
- Dockerfile
- LICENSE
- lombok.config
- mvnw
- mvnw.cmd
- NOTICE
- pom.xml
- README.md
# 설치 가이드
1. 코드 내려받기
git clone https://github.com/apache/incubator-xtable
깃허브에서 프로젝트 코드 전체를 내 컴퓨터로 내려받습니다.
cd incubator-xtable
방금 내려받은 프로젝트 폴더 안으로 이동합니다.
2. Docker
쉬움 추천사전 준비물
- Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
- Docker Desktop 컨테이너를 빌드하고 실행하려면 필요합니다. 설치 후 실행해서 백그라운드에 켜두세요.
docker run \
빌드된 이미지를 실제 컨테이너로 실행합니다.
터미널에 docker compose ps 를 입력해 컨테이너들이 Up 상태인지 확인하세요. README에 포트 번호가 적혀있다면 브라우저에서 http://localhost:포트번호 로 접속해보세요.
이 레포의 README에 적힌 실제 명령어를 그대로 가져왔습니다.
3. Maven (Java)
보통사전 준비물
- Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
- JDK (Java) Java 프로젝트를 빌드/실행하려면 필요합니다.
- Maven mvn 명령어를 쓰기 위한 빌드 도구입니다.
mvn clean install
Maven으로 의존성 설치와 빌드를 진행합니다.
BUILD SUCCESS 메시지가 뜨면 성공입니다. target/ 폴더에 결과물이 생성됩니다.
4. Python
쉬움사전 준비물
pip install -r spec/requirements.txt
requirements.txt 등에 명시된 파이썬 라이브러리를 설치합니다.
jupyter notebook
브라우저에서 노트북(.ipynb) 파일들을 열람하고 실행할 수 있는 Jupyter 화면을 켭니다.
에러 메시지 없이 실행되고 터미널에 안내 문구가 출력되면 정상입니다.
5. Make
보통사전 준비물
- Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
- Make Linux/macOS는 보통 기본 설치되어 있습니다. Windows는 별도 설치(예: MSYS2, WSL)가 필요합니다.
cd spec
이 프로젝트의 관련 파일이 하위 폴더 안에 있어서, 먼저 그 폴더로 이동합니다.
make
생성된 빌드 설정을 바탕으로 실제 컴파일을 진행해 실행 파일을 만듭니다.
에러 없이 끝나면 성공입니다. 생성된 실행 파일을 직접 실행해보세요.
// repository documentation
Was this content helpful?
(0 ratings)
