Azure_Metadata_Driven_ETL_Framework

★ 2 Open GitHub ↗

An enterprise level, scalable metadata-driven ETL framework in Azure using Azure Data Factory V2, Azure Data Lake Gen2, Databricks and Azure SQL DB and Synapse which can perform incremental and full data loads from any given source for any number of entities. All configuration is maintained in a single Azure SQL DB acting as the control database.

Explore Similar Repositories

AzureSynapseScriptsAndAccelerators : No description available.
Test-Drive-Azure-Synapse-with-a-1-click-POC : No description available.
azure-kusto-trender : A JavaScript client for Kusto (Azure Data Explorer, Synapse Data Explorer, Kusto free), featuring components for making calls directly to Kusto, rendering results from the API, and more
dataverse-to-sql : Repository of the DataverseToSql tool for the incremental copy of data between Synapse Link for Dataverse and Azure SQL Database
azure.synapse.tools : PowerShell module to deploy Synapse workspace (and more) in Microsoft Azure.
// repository documentation