docker-spark-adls

★ 4 Open GitHub ↗

A docker image to make ADLS Gen2 available on the local file system for Spark applications.

Explore Similar Repositories

tfl-analytics-pipeline : Azure data analytics platform for Transport for London using Databricks, ADF, and ADLS Gen2 - Infrastructure as Code with Bicep
adlsgen1togen2migration : ADLS Gen1 to Gen2 Migration Guidance Repo
covid19-data-engineering : End-to-end Azure Data Engineering pipeline using ADF, Databricks (PySpark), ADLS Gen2, Azure SQL, and Power BI for COVID-19 analytics
Automate-GDPR-User-Data-Erasure-Requests : Built an automated deletion pipeline using ADLS Gen2 and Databricks to ingest data daily, process it into Delta tables, and reliably erase all user-related records with full auditability.
azurefactory-databricks : Dive into the Medallion Architecture with this Azure Data Engineering Pipeline! Built with ADF, Databricks, and ADLS Gen2, it automates ELT, handles SCDs like a pro, and brings data to life with Delta and CDC magic. Perfect for data enthusiasts ready to level up!
// repository documentation