smart-data-lake
Smart Automation Tool for building modern Data Lakes and Data Pipelines
파일 탐색기
최종 버전 다운로드 (.zip)- bug_report.md
- feature_request.md
- deploy-docs.yml
- release.yml
- release_debezium_connector_shaded.yml
- release_kafka_schema_registry_shaded.yml
- snapshot_build.yml
- test-deploy-docs.yml
- pull_request_template.md
- codeStyleConfig.xml
- Project.xml
- GPLv3.xml
- profiles_settings.xml
- _template__of_ScalaTest.xml
- AtlasExporter.xml
- DebeziumCdcDataObjectPostgresIT.xml
- JsonSchemaExporter.xml
- SmartDataLakeBuilder.xml
- encodings.xml
- scala_settings.xml
- vcs.xml
- 2022-03-18-SDL-airbyte.md
- application.conf
- github_spec_out.json
- polynote_commits.png
- SelectingData.ipynb
- 2022-04-06-SDL-snowpark.md
- 2022-05-11-historization.md
- chess.conf
- db_init_chess.sql
- db_mod_chess.sql
- db_mod_chess_cdc.sql
- Dockerfile.txt
- historization_res.png
- restart_databases.sh
- sql_data_monitor.ipynb
- start_buildah.sh
- 2023-06-08-housekeeping.md
- 2023-09-17-data-mesh.md
- 2024-09-27-UI-Demo.md
- btl-distance-config.png
- btl-distance-des.png
- btl-distance-schema.png
- compute-distance-config.png
- compute-distance-lineage.png
- home.png
- timeline.png
- 2024-12-12-Databricks.md
- code_completion.png
- copy_path.png
- 2025-07-16-Debezium.md
- debezium-architecture.png
- sdlb-debezium-offset.png
- sdlb-debezium-pipeline.png
- sdlb-debezium.png
- compute-distances.md
- get-airports.md
- get-departures.md
- joining-departures-and-arrivals.md
- joining-it-together.md
- select-columns.md
- delta-lake-format.md
- environments.md
- historical-data.md
- industrializing.md
- custom-webservice.md
- incremental-mode.md
- metadata.md
- common-problems.md
- docker-on-windows.md
- get-input-data.md
- setup.md
- agents-example.png
- databricks_job.png
- dataobject_catalog.png
- dataobject_hierarchy.png
- ELCA_logo.png
- execution_engines_layers.png
- feed.drawio
- feed.png
- google_01_upload_jar.png
- google_02_job.png
- google_03_result.png
- lineage_expanded.png
- SBB_logo.png
- schema-viewer-information.png
- schema-viewer-search.png
- schema-viewer-ui.png
- secrets_schema_viewer.png
- agents-example.puml
- customDataFrameAction.md
- deduplicateAction.md
- historizeAction.md
- actions.md
- agents.md
- build.md
- commandLine.md
- dag.md
- dataObjects.md
- dataQuality.md
- deploy-google-dataproc.md
- deploy-microsoft-azure.md
- deploymentOptions.md
- deployYarn.md
- executionEngines.md
- executionModes.md
- executionPhases.md
- extending.md
- glossary.md
- hoconOverview.md
- hoconSecrets.md
- hoconVariables.md
- housekeeping.md
- notebookCatalog.md
- runState.md
- schema-viewer-navigation.md
- schema.md
- streaming.md
- testing.md
- transformations.md
- troubleshooting.md
- component-001-legend.png
- component-001.png
- container-001-legend.png
- container-001.png
- extension.png
- README.md
- workspace.dsl
- workspace.json
- architecture.md
- contribution.md
- features.md
- intro.md
- reference.md
- custom.css
- index.js
- json-schema-viewer.js
- styles.module.css
- SchemaViewerComponent.js
- UseColorMode.js
- Apache_Spark_logo.svg
- chain.svg
- checklist.svg
- favicon.ico
- idx_automated.png
- idx_automated_200px.png
- idx_declarative.png
- idx_declarative_200px.png
- idx_open.png
- idx_open_200px.png
- sdl_logo.png
- undraw_docusaurus_mountain.svg
- undraw_docusaurus_react.svg
- undraw_docusaurus_tree.svg
- sdl-schema-2.2.0.json
- sdl-schema-2.2.1.json
- sdl-schema-2.3.0.json
- sdl-schema-2.3.1.json
- sdl-schema-2.3.2.json
- sdl-schema-2.4.0.json
- sdl-schema-2.4.1.json
- sdl-schema-2.4.2.json
- sdl-schema-2.5.0.json
- sdl-schema-2.5.1.json
- sdl-schema-2.5.2.json
- sdl-schema-2.6.0.json
- sdl-schema-2.6.1.json
- sdl-schema-2.7.0.json
- sdl-schema-2.7.1.json
- sdl-schema-2.7.2.json
- sdl-schema-2.8.0.json
- sdl-schema-2.8.1.json
- sdl-schema-2.9.0.json
- sdl-schema-2.9.1-SNAPSHOT.json
- sdl-schema-3.0.0-SNAPSHOT.json
- .nojekyll
- CNAME
- CODE_OF_CONDUCT.md
- CONTRIBUTING.md
- COPYING
- GOVERNANCE.md
- .gitignore
- .npmrc
- babel.config.js
- create-schema-index.js
- docusaurus.config.js
- package.json
- README.md
- sidebars.js
- yarn.lock
- gplv3-header.txt
- LogAnalyticsClient.java
- LogAnalyticsHttpCollectorAppenderPlugin.java
- LogAnalyticsIngestionAppenderPlugin.java
- LogAnalyticsSendBuffer.java
- LogAnalyticsSendBufferClient.java
- LogAnalyticsSendBufferTask.java
- GenericSendBuffer.java
- GenericSendBufferTask.java
- LogAnalyticsSdlbLayout.json
- LogAnalyticsSdlbLayout.json.sample
- LocalAzureRelayAgentSmartDataLakeBuilder.scala
- AzureRelayAgentServer.scala
- AzureRelayAgentServerConfig.scala
- AzureADClientGrantAuthMode.scala
- AzureKeyVaultSecretProvider.scala
- Log4j2InitPlugin.scala
- LogAnalyticsAppender.scala
- LogAnalyticsBackend.scala
- StateChangeLogger.scala
- AzureRelayAgent.scala
- LogAnalyticsClientTester.java
- application-azureRelayAgent.conf
- SmartDataLakeBuilderAzureRelayAgentIT.scala
- pom.xml
- gplv3-header.txt
- log4j2.yml
- AppUtil.scala
- BackendClient.scala
- CanBuildSmartDataLakeBuilderConfig.scala
- DefaultSmartDataLakeBuilder.scala
- GlobalConfig.scala
- GlueSmartDataLakeBuilder.scala
- LocalJettyAgentSmartDataLakeBuilder.scala
- LocalStorageAgentSmartDataLakeBuilder.scala
- MemoryLogTimerConfig.scala
- ModulePlugin.scala
- SDLPlugin.scala
- SmartDataLakeBuilder.scala
- StateListener.scala
- StatusInfoConfig.scala
- UIBackendConfig.scala
- VersionInfoWriter.scala
- AgentClient.scala
- AgentServerController.scala
- JettyAgentClientSocket.scala
- JettyAgentServer.scala
- JettyAgentServerConfig.scala
- JettyAgentServerSocket.scala
- StorageAgentServer.scala
- ActionLog.scala
- AgentInstruction.scala
- AgentResult.scala
- SDLMessage.scala
- SDLMessageMetadata.scala
- SDLMessageType.scala
- StatusUpdate.scala
- SnapshotStatusInfoListener.scala
- StatusInfoMethods.scala
- StatusInfoServletContext.scala
- IncrementalStatusInfoListener.scala
- StatusInfoSocket.scala
- StatusInfoServer.scala
- ExportWriter.scala
- FileExportWriter.scala
- HadoopExportWriter.scala
- HttpExportWriter.scala
- ConfigHolder.scala
- ConfigImplicits.scala
- ConfigLoader.scala
- ConfigParser.scala
- ConfigToolbox.scala
- ConfigurationException.scala
- ConfigUtil.scala
- FactoryMethod.scala
- FromConfigFactory.scala
- InstanceRegistry.scala
- ParsableFromConfig.scala
- SdlConfigObject.scala
- CdcChangeType.scala
- ColumnStatsType.scala
- Condition.scala
- DateColumnType.scala
- Environment.scala
- SDLSaveMode.scala
- TableStatsType.scala
- Await.scala
- DAG.scala
- DAGException.scala
- GraphLayout.scala
- NodeRenderingStrategy.scala
- SchemaEvolution.scala
- SchemaEvolutionException.scala
- TypeConsolidation.scala
- FileTransfer.scala
- SshUtil.scala
- StreamFileTransfer.scala
- FileSystemFactory.scala
- HdfsUtil.scala
- Partition.scala
- UCFileSystemFactory.scala
- CdcHistorizeMode.scala
- Historization.scala
- HistorizeMode.scala
- IncrementalHistorizeMode.scala
- SdlJsonUtils.scala
- CustomCodeUtil.scala
- DateUtil.scala
- DynamicTransformMethod.scala
- EnvironmentUtil.scala
- ExpressionUtil.scala
- FileUtil.scala
- FinalMetricsLogWriter.scala
- FinalStateWriter.scala
- GenericSchemaUtil.scala
- GraphUtil.scala
- HoconUtil.scala
- JdbcUtil.scala
- Log4j2ConsoleInitPlugin.scala
- LogUtil.scala
- MemoryUtils.scala
- MetricsUtil.scala
- NameUtil.scala
- NestedColumnUtil.scala
- PerformanceUtils.scala
- ProductUtil.scala
- ReflectionUtil.scala
- ResourceUtil.scala
- ScaladocUtil.scala
- ScalaUtil.scala
- SchemaProvider.scala
- SchemaUtil.scala
- SeqUtil.scala
- SerializableHadoopConfiguration.scala
- SmartDataLakeLogger.scala
- SQLUtil.scala
- StateUploader.scala
- StringUtil.scala
- URIUtil.scala
- WaitUtil.scala
- WithResourcePool.scala
- ClearTextSecretProvider.scala
- DatabricksSecretProvider.scala
- EnvironmentVariableSecretProvider.scala
- FileSecretProvider.scala
- SecretProvider.scala
- SecretsUtil.scala
- StringOrSecret.scala
- OAuth2Service.scala
- SttpUtil.scala
- SttpWebserviceClient.scala
- WebserviceClient.scala
- WebserviceException.scala
- WebserviceMethod.scala
- Compare.scala
- Constants.scala
- LogUtils.scala
- OriginTag.scala
- PrecisionDef.scala
- CustomPartitionMode.scala
- DataFrameIncrementalMode.scala
- DataFrameStreamingExecutionMode.scala
- DataObjectStateIncrementalMode.scala
- ExecutionMode.scala
- PartitionDiffMode.scala
- CompletenessExpectation.scala
- TransferRateExpectation.scala
- CustomGenericDfsTransformer.scala
- CustomGenericDfTransformer.scala
- CustomTransformMethodDef.scala
- GenericTransformMappers.scala
- BinaryDecisionDiagramTransformer.scala
- BlacklistTransformer.scala
- ColumnsTransformer.scala
- ConvertNullValuesTransformer.scala
- DataValidationTransformer.scala
- DebugTransformer.scala
- DeduplicateTransformer.scala
- DfTransformerWrapperDfsTransformer.scala
- FilterTransformer.scala
- GenericDfsTransformerDef.scala
- GenericDfTransformerDef.scala
- ScalaClassGenericDfsTransformer.scala
- ScalaClassGenericDfTransformer.scala
- SQLDfsTransformer.scala
- SQLDfTransformer.scala
- StandardizeColNamesTransformer.scala
- WhitelistTransformer.scala
- CmdScript.scala
- DockerRunScript.scala
- ScriptDef.scala
- Action.scala
- ActionExpressionData.scala
- ActionHelper.scala
- ActionSubFeedsImpl.scala
- CopyAction.scala
- CustomDataFrameAction.scala
- CustomScriptAction.scala
- DataFrameActionImpl.scala
- DataFrameOneToOneActionImpl.scala
- DeduplicateAction.scala
- FileOneToOneActionImpl.scala
- FileTransferAction.scala
- HistorizeAction.scala
- MetricsCheckFailed.scala
- NoDataToProcessWarning.scala
- ProxyAction.scala
- RuntimeData.scala
- ScriptActionImpl.scala
- TimeOrderLogicException.scala
- Agent.scala
- JettyAgent.scala
- StorageAgent.scala
- AuthHeaderMode.scala
- AuthMode.scala
- AWSUserPwdAuthMode.scala
- BasicAuthMode.scala
- CustomHttpAuthMode.scala
- OAuthMode.scala
- PublicKeyAuthMode.scala
- SASLSCRAMAuthMode.scala
- SSLCertsAuthMode.scala
- TokenAuthMode.scala
- Connection.scala
- DeltaLakeTableConnection.scala
- HadoopFileConnection.scala
- IcebergTableConnection.scala
- ScalaConnection.scala
- SFtpFileRefConnection.scala
- ExpressionParser.scala
- ScalaAbstractColumn.scala
- ScalaColumn.scala
- ScalaColumnDefinition.scala
- ScalaDataFrame.scala
- ScalaDataType.scala
- ScalaExplodeExpr.scala
- ScalaExpressionEvaluatorFactory.scala
- ScalaGroupedDataFrame.scala
- ScalaRow.scala
- ScalaSchema.scala
- ScalaSubFeed.scala
- DataFrameFunctions.scala
- DataFrameObservation.scala
- GenericDataFrame.scala
- LazyGenericSchema.scala
- SchemaConverter.scala
- Expectation.scala
- SQLExpectation.scala
- SQLFractionExpectation.scala
- SQLQueryExpectation.scala
- UniqueKeyExpectation.scala
- CanCreateInputStream.scala
- CanCreateOutputStream.scala
- FileDataObject.scala
- FileRefDataObject.scala
- HadoopFileDataObject.scala
- HasHadoopStandardFilestore.scala
- ZipCsvCodec.scala
- CanCreateDataFrame.scala
- CanCreateIncrementalOutput.scala
- CanEvolveSchema.scala
- CanHandleConstraints.scala
- CanHandlePartitions.scala
- CanMergeDataFrame.scala
- CanWriteDataFrame.scala
- ConnectionTestException.scala
- Constraint.scala
- DataObjectEngine.scala
- ExpectationValidation.scala
- HousekeepingMode.scala
- SchemaValidation.scala
- Table.scala
- TableDataObject.scala
- TransactionalTableDataObject.scala
- UserDefinedSchema.scala
- CanReceiveScriptNotification.scala
- DataObject.scala
- DeltaLakeTableDataObject.scala
- IcebergTableDataObject.scala
- PKViolatorsDataObject.scala
- SFtpFileRefDataObject.scala
- WebserviceFileDataObject.scala
- ActionDAGRun.scala
- ActionDAGRunState.scala
- ActionPipelineContext.scala
- ActionsRuntimeRegistry.scala
- ColumnFilter.scala
- DataFrameCacheRegistry.scala
- DataFrameSubFeed.scala
- FileSubFeed.scala
- HadoopFileActionDAGRunStateStore.scala
- InitSubFeed.scala
- PrimaryKeyConstraintViolationException.scala
- ProcessingLogicException.scala
- RunStatistics.scala
- SchemaViolationException.scala
- ScriptSubFeed.scala
- StateMigratorDef.scala
- SubFeed.scala
- file.txt
- .gitkeep
- config2.conf
- file.txt
- foo.json
- .hidden.conf
- bar.conf
- config.conf
- externalExtension.conf
- config.conf
- configDuplicate.conf
- config.conf
- default.conf
- testJsonSchema.json
- application.conf
- log4j2.yml
- test_keystore.pkcs12
- ExternalExtensionTest.scala
- GlobalConfigTest.scala
- SmartDataLakeBuilderTest.scala
- TestConnection.scala
- TestHousekeepingMode.scala
- ConfigLoaderTest.scala
- MockScalaDataObject.scala
- ScalaTestUtil.scala
- BlacklistTransformerBehaviour.scala
- CaptureRunContext.scala
- ColumnsTransformerBehaviour.scala
- ConvertNullValuesTransformerBehaviour.scala
- CopyActionBehaviour.scala
- DataFrameSubFeedFilterBehaviour.scala
- DataValidationTransformerBehaviour.scala
- DebugTransformerBehaviour.scala
- DeduplicateActionBehaviour.scala
- DeduplicateTransformerBehaviour.scala
- GenericTestTool.scala
- HistorizeActionBehaviour.scala
- MemoryDagRunStateStore.scala
- SmartDataLakeBuilderBehaviour.scala
- SQLDfsTransformerBehaviour.scala
- SQLDfTransformerBehaviour.scala
- StandardizeColNamesTransformerBehaviour.scala
- TableDataObjectBehaviour.scala
- TestStateListener.scala
- WhitelistTransformerBehaviour.scala
- HdfsUtilTest.scala
- PartitionLayoutTest.scala
- PartitionValuesTest.scala
- HistorizationTestUtils.scala
- DateUtilTest.scala
- EnvironmentUtilTest.scala
- GraphUtilTest.scala
- HoconUtilTest.scala
- ProductUtilTest.scala
- SchemaProviderTest.scala
- URIUtilTest.scala
- SecretsUtilTest.scala
- CompareTest.scala
- CustomGenericTransformerTest.scala
- BlacklistTransformerTest.scala
- ColumnTransformerTest.scala
- ConvertNullValuesTransformerTest.scala
- DataValidationTransformerTest.scala
- DebugTransformerTest.scala
- DeduplicateTransformerTest.scala
- SQLDfsTransformerTest.scala
- SQLDfTransformerTest.scala
- StandardizeColNamesTransformerTest.scala
- WhitelistTransformerTest.scala
- DeduplicateWithMergeActionTest.scala
- HistorizeWithMergeActionTest.scala
- OfflineCopyActionTest.scala
- CmdScriptTest.scala
- ActionHelperTest.scala
- OAuthModeIT.scala
- ExpressionParserTest.scala
- ScalaAbstractColumnTest.scala
- ScalaDataFrameTest.scala
- ScalaSubFeedFilterTest.scala
- ScalaSubFeedTest.scala
- DataObjectEngineTest.scala
- ColumnFilterTest.scala
- DAGTest.scala
- ExecutionIdTest.scala
- FileSubFeedTest.scala
- StateMigratorDef5To6Test.scala
- TestSchemaProvider.scala
- pom.xml
- DebeziumConnectorMariaDbDummy.java
- pom.xml
- DebeziumConnectorMysqlDummy.java
- pom.xml
- gplv3-header.txt
- DebeziumChangeConsumer.scala
- DebeziumCompletionCallback.scala
- DebeziumSchemaConsumer.scala
- SdlbDebeziumChangeConsumerState.scala
- SDLBDebeziumOffsetStorage.scala
- DebeziumConnection.scala
- DebeziumCdcDataObject.scala
- application.conf
- DebeziumCdcDataObjectMariaDBIT.scala
- DebeziumCdcDataObjectMySqlIT.scala
- DebeziumCdcDataObjectMySqlParallelIT.scala
- DebeziumCdcDataObjectMySqlS3SchemaHistoryIT.scala
- DebeziumCdcDataObjectOracleIT.scala
- DebeziumCdcDataObjectPostgresqlBigTableIT.scala
- DebeziumCdcDataObjectPostgresqlColdStartTableIT.scala
- DebeziumCdcDataObjectPostgresqlIT.scala
- DebeziumEventConverterTest.scala
- oracle_podman.png
- pom.xml
- README.md
- gplv3-header.txt
- DeltaLakeModulePlugin.scala
- DeltaLakeTableSparkClassicEngine.scala
- application.conf
- DeltaLakeDeduplicateWithMergeActionTest.scala
- DeltaLakeHistorizeWithMergeActionTest.scala
- DeltaLakeTableDataObjectTest.scala
- DeltaLakeTestUtils.scala
- pom.xml
- gplv3-header.txt
- GCPCredentialsKeyAuth.scala
- BigQueryTableConnection.scala
- BigQueryTableDataObject.scala
- google.conf
- pom.xml
- gplv3-header.txt
- IcebergModulePlugin.scala
- IcebergTableSparkClassicEngine.scala
- log4j2.yml
- IcebergCustomDataFrameTest.scala
- IcebergDeduplicateWithMergeActionTest.scala
- IcebergHistorizeWithMergeActionTest.scala
- IcebergTableDataObjectTest.scala
- IcebergTestUtils.scala
- pom.xml
- EmbeddedKafkaSchemaRegistryDummy.java
- pom.xml
- gplv3-header.txt
- KafkaConnection.scala
- KafkaTopicDataObject.scala
- KafkaStateIncrementalMode.scala
- User.java
- KafkaTestUtil.scala
- KafkaTopicDataObjectTest.scala
- ActionDAGKafkaTest.scala
- pom.xml
- gplv3-header.txt
- labConfigTest.conf
- log4j2.yml
- DataFrameBaseBuilder.scala
- LabCatalogGenerator.scala
- LabSparkActionWrapper.scala
- LabSparkDataObjectWrapper.scala
- SmartDataLakeBuilderLab.scala
- ConfigJsonExporter.scala
- DataObjectSchemaExporter.scala
- DagExporter.scala
- SimplifiedAction.scala
- JsonSchemaDef.scala
- JsonSchemaExporter.scala
- JsonSchemaUtil.scala
- StateMigrator.scala
- GenericTypeDef.scala
- GenericTypeUtil.scala
- dataObjectParquet6.md
- dagexporterTest.conf
- application.conf
- log4j2.yml
- stateFileV2.json
- FactoryMethodCompletenessTest.scala
- LabCatalogGeneratorTest.scala
- LabSparkActionWrapperTest.scala
- LabSparkDataObjectWrapperTest.scala
- SmartDataLakeBuilderLabTest.scala
- Tgt1DfsTransformer.scala
- ConfigJsonExporterTest.scala
- DataObjectSchemaExporterTest.scala
- DynamicTestTransformer.scala
- ScalaDocExportTestTransformer.scala
- DagExporterTest.scala
- JsonTypeConverterTest.scala
- GenericTypeUtilTest.scala
- pom.xml
- gplv3-header.txt
- SnowparkUtils.scala
- CustomSnowparkDfsTransformer.scala
- CustomSnowparkDfTransformer.scala
- SnowparkTransformMappers.scala
- ScalaClassSnowparkDfsTransformer.scala
- ScalaClassSnowparkDfTransformer.scala
- SnowflakeConnection.scala
- SnowparkDataFrame.scala
- SnowparkSchemaConverter.scala
- SnowparkSubFeed.scala
- SnowflakeTableDataObject.scala
- SnowflakeConnectionConfig.scala
- SnowflakeDataObjectIT.scala
- SnowflakeSubFeedTest.scala
- SnowparkIT.scala
- SnowparkSchemaConverterTest.scala
- SparkAndSnowparkDataPipelineIT.scala
- pom.xml
- gplv3-header.txt
- SparkSaveModeUtil.scala
- DatabricksCrypt.scala
- EncryptDecrypt.scala
- EncryptDecryptECB.scala
- EncryptDecryptGCM.scala
- SparkHdfsUtil.scala
- JdbcExecution.scala
- SdlbXsdURIResolver.scala
- CommentedColumn.scala
- Equality.scala
- package.scala
- Quality.scala
- ReadWrite.scala
- StructTypeUtil.scala
- Transform.scala
- FieldProjector.scala
- TypeEvolutionUtil.scala
- ValueProjector.scala
- DefaultFlatteningParser.scala
- Json4sJsonPathProvider.scala
- JsonUtils.scala
- AnalyzeTableException.scala
- AssertNotEmpty.scala
- CollectSetDeterministic.scala
- DummyStreamProvider.scala
- GetSession.scala
- NullAwareMurmur3HashExpr.scala
- PushPredicateThroughTolerantCollectMetricsRule.scala
- PythonUtil.scala
- SDLSparkExtension.scala
- SparkExpressionUtil.scala
- SparkPlanNoDataCheckRule.scala
- SparkProductUtil.scala
- SparkRepartitionDef.scala
- SparkSchemaProvider.scala
- SparkSchemaUtil.scala
- SparkSQLUtil.scala
- SparkStageMetrics.scala
- SparkStageMetricsListener.scala
- SparkStreamingQueryListener.scala
- TableInformationException.scala
- WoodstoxXMLOutputFactory.scala
- OpenApiUtil.scala
- FileIncrementalMoveMode.scala
- SparkStreamingMode.scala
- CustomDfsTransformer.scala
- CustomDfTransformer.scala
- CustomFileTransformer.scala
- PySparkUDFCreatorConfig.scala
- SparkTransformMappers.scala
- SparkUDFCreator.scala
- DecryptColumnsTransformer.scala
- EncryptColumnsTransformer.scala
- PythonCodeSparkDfsTransformer.scala
- PythonCodeSparkDfTransformer.scala
- PythonDynamicTransform.scala
- ScalaClassSparkDfsTransformer.scala
- ScalaClassSparkDfTransformer.scala
- ScalaCodeSparkDfsTransformer.scala
- ScalaCodeSparkDfTransformer.scala
- ScalaNotebookSparkDfTransformer.scala
- SparkDfsTransformerDef.scala
- SparkDfTransformerDef.scala
- SparkFlattenDfTransformer.scala
- SparkRepartitionTransformer.scala
- StandardizeSparkDatatypesTransformer.scala
- CustomFileAction.scala
- HSQLDbDialect.scala
- JdbcCatalog.scala
- JdbcTableConnection.scala
- MariaDbDialect.scala
- SparkClassicConnection.scala
- SparkDataFrame.scala
- SparkObservation.scala
- SparkSubFeed.scala
- AvgCountPerPartitionExpectation.scala
- CountExpectation.scala
- CanCreateSparkDataFrame.scala
- CanCreateStreamingDataFrame.scala
- CanWriteSparkDataFrame.scala
- DataStreamWriterOptions.scala
- SparkDataObjectOps.scala
- SparkFileDataObject.scala
- AccessTableDataObject.scala
- ActionsExporterDataObject.scala
- AirbyteDataObject.scala
- AirbyteMessage.scala
- AvroFileDataObject.scala
- CsvFileDataObject.scala
- DataObjectsExporterDataObject.scala
- ExcelFileDataObject.scala
- JdbcTableDataObject.scala
- JsonFileDataObject.scala
- ODataDataObject.scala
- ODataResponseBuffer.scala
- OpenApiDataObject.scala
- ParquetFileDataObject.scala
- RawFileDataObject.scala
- RelaxedCsvFileDataObject.scala
- XmlFileDataObject.scala
- SimplifiedAnalysisException.scala
- test_python_dynamic_transform.py
- file.txt
- .gitkeep
- config2.conf
- file.txt
- foo.json
- .hidden.conf
- bar.conf
- config.conf
- agent-main.conf
- agent-remote-server.conf
- WithFinalStateWriter.conf
- WithRealUIBackend.conf
- application.conf
- testJsonSchema.json
- sampleApiDoc.json
- sampleApiDocPaging.json
- basket.xml
- basket.xsd
- complex.xml
- complex.xsd
- lists.xml
- lists.xsd
- AB_NYC_2019.csv
- airbyteConnectorMock.sh
- log4j2.yml
- stateFileV2.json
- test_database.accdb
- test_database.mdb
- AppUtilTest.scala
- SmartDataLakeBuilderAgentTest.scala
- SmartDataLakeBuilderStatusInfoTest.scala
- SmartDataLakeBuilderStreamingTest.scala
- SmartDataLakeBuilderTest.scala
- ExportWriterTest.scala
- TestAction.scala
- TestDataObject.scala
- TestFileTransformer.scala
- ActionImplTests.scala
- ConfigParsingTest.scala
- ConfigsMacroDebug.scala
- DataObjectImplTests.scala
- TestCustomDfsTransformer.scala
- Collection.scala
- MockSparkDataObject.scala
- SparkTestTool.scala
- SparkTestUtil.scala
- DataFrameTestHelper.scala
- DataObjectTestSuite.scala
- SshTestUtil.scala
- WebserviceTestUtil.scala
- DatabricksCryptTest.scala
- SchemaEvolutionTest.scala
- TypeEvolutionUtilTest.scala
- IncrementalCDCHistorizationTest.scala
- IncrementalHistorizationTest.scala
- JsonUtilsTest.scala
- ExpressionUtilTest.scala
- NestedColumnUtilTest.scala
- SchemaUtilTest.scala
- StringUtilTest.scala
- DsCommentTest.scala
- DsPkTest.scala
- DsQualityTest.scala
- EqualityTest.scala
- StructTypeUtilTest.scala
- TestCaseClass.scala
- TestInnerClass.scala
- TransformTest.scala
- SDLSparkExtensionTest.scala
- SparkExpressionUtilTest.scala
- OpenApiUtilTest.scala
- WebserviceClientTest.scala
- CustomFileActionTest.scala
- FileTransferActionTest.scala
- BlacklistTransformerTest.scala
- ColumnTransformerTest.scala
- ConvertNullValuesTransformerTest.scala
- DataValidationTransformerTest.scala
- DebugTransformerTest.scala
- DeduplicateTransformerTest.scala
- SQLDfsTransformerTest.scala
- SQLDfTransformerTest.scala
- StandardizeColNamesTransformerTest.scala
- WhitelistTransformerTest.scala
- CustomScriptActionTest.scala
- CustomDfsTransformerTest.scala
- DynamicTransformTest.scala
- EncryptColumnsTransformerTest.scala
- PythonCodeDfTransformerTest.scala
- PythonDynamicTransformTest.scala
- ScalaNotebookSparkDfTransformerTest.scala
- SparkFlattenDFTransformerTest.scala
- CopyActionTest.scala
- CopyCustomDfTest.scala
- CopyWithMergeActionTest.scala
- CustomDataFrameActionTest.scala
- DeduplicateActionTest.scala
- DeduplicateWithMergeActionTest.scala
- ExecutionModeTest.scala
- HistorizeActionCheckInputUniqueTest.scala
- HistorizeActionTest.scala
- HistorizeWithMergeActionTest.scala
- JdbcHistorizeWithMergeActionTest.scala
- OfflineCopyActionTest.scala
- JdbcTableConnectionTest.scala
- MariaDbDialectTest.scala
- SparkClassicConnectionTest.scala
- SparkSubFeedFilterTest.scala
- SparkSubFeedTest.scala
- ConstraintAndExpectationSetupErrorTest.scala
- UniqueKeyExpectationTest.scala
- ValidateOnReadTest.scala
- AccessTableDataObjectTest.scala
- AirbyteDataObjectTest.scala
- AvroFileDataObjectTest.scala
- CsvFileDataObjectTest.scala
- ExcelFileDataObjectTest.scala
- ExportMetadataDataObjectTest.scala
- HousekeepingModeTest.scala
- JdbcTableDataObjectTest.scala
- JsonFileDataObjectTest.scala
- ODataDataObjectTest.scala
- ODataResponseFileBufferTest.scala
- ODataResponseMemoryBufferTest.scala
- OpenApiDataObjectIT.scala
- OpenApiDataObjectTest.scala
- ParquetFileDataObjectTest.scala
- PKViolatorsDataObjectTest.scala
- RawFileDataObjectTest.scala
- RelaxedCsvFileDataObjectTest.scala
- SFtpFileRefDataObjectTest.scala
- SparkFileDataObjectSchemaBehavior.scala
- SparkFileDataObjectTest.scala
- UnpartitionedTestDataObject.scala
- XmlFileDataObjectTest.scala
- ActionDAGRunTest.scala
- ActionDAGTest.scala
- RuntimeDataTest.scala
- pom.xml
- gplv3-header.txt
- ReadWrite.scala
- SparkConnectConnection.scala
- SparkConnectDataFrame.scala
- SparkConnectObservation.scala
- SparkConnectSchemaProvider.scala
- SparkConnectSubFeed.scala
- DeltaLakeTableSparkConnectEngine.scala
- IcebergTableSparkConnectEngine.scala
- SparkConnectTableDataObject.scala
- SparkConnectTableUtil.scala
- ColumnUtil.scala
- e2e.conf
- sparkconnect.conf
- SparkConnectTestUtil.scala
- DeltaLakeTableDataObjectTest.scala
- DeltaLakeTableSparkConnectEngineTest.scala
- IcebergTableDataObjectTest.scala
- IcebergTableSparkConnectEngineTest.scala
- SparkConnectConfigParsingTest.scala
- SparkConnectDataObjectTest.scala
- SparkConnectDeduplicateActionTest.scala
- SparkConnectHistorizeActionTest.scala
- SparkConnectPipelineTest.scala
- SparkConnectSchemaTest.scala
- SparkConnectTableDataObjectBehaviourTest.scala
- pom.xml
- README.md
- start-spark-connect.sh
- .gitattributes
- .gitignore
- .scalafmt.conf
- .travis.yml
- AGENTS.md
- CODE_OF_CONDUCT.md
- CONTRIBUTING.md
- COPYING
- GOVERNANCE.md
- pom.xml
- README.md
- RELEASE.md
// repository documentation
Was this content helpful?
(0 ratings)