azure-cloud-datapipeline-EDA
A cloud-native data pipeline and visualization project analyzing Formula 1 racing data using Azure, Databricks, Delta Lake, Tableau, and Python for insightful EDA and interactive dashboards.
File Explorer
Download Latest Version (.zip)- dataset_formula1_raw.json
- ds_processed_layer_circuits.json
- ds_processed_layer_constructors.json
- ds_processed_layer_drivers.json
- ds_processed_layer_lap_times.json
- ds_processed_layer_pit_stops.json
- ds_processed_layer_qualifying.json
- ds_processed_layer_races.json
- ds_processed_layer_results.json
- azure-cloud-datapipeline-EDA-project-adf.json
- azure-cloud-datapipeline-EDA-project-datafactory.json
- azure_cloud_datapipeline_EDA_project_databrick_ws.json
- ls_smarsproject0datalake.json
- batch_workflow.json
- ppl_formula1_project_data_ingestion.json
- ppl_formula1_project_data_transformation.json
- trg_formula1_data_batch_flow.json
- publish_config.json
- lap_times_split_1.csv
- lap_times_split_2.csv
- lap_times_split_3.csv
- lap_times_split_4.csv
- lap_times_split_5.csv
- qualifying_split_1.json
- qualifying_split_2.json
- circuits.csv
- constructors.json
- drivers.json
- pit_stops.json
- races.csv
- results.json
- lap_times_split_1.csv
- qualifying_split_1.json
- circuits.csv
- constructors.json
- drivers.json
- pit_stops.json
- races.csv
- results.json
- lap_times_split_1.csv
- qualifying_split_1.json
- circuits.csv
- constructors.json
- drivers.json
- pit_stops.json
- races.csv
- results.json
- azure-cloud-datapipeline-EDA.dbc
- azure-cloud-datapipeline-EDA-project-adf_ARMTemplateForFactory.json
- azure-cloud-datapipeline-EDA-project-adf_ARMTemplateParametersForFactory.json
- ArmTemplate_0.json
- ArmTemplate_master.json
- ArmTemplateParameters_master.json
- ARMTemplateForFactory.json
- ARMTemplateParametersForFactory.json
- parameters.json
- template.json
- WechatIMG51.jpg
- WechatIMG52.jpg
- WechatIMG53.jpg
- WechatIMG56.jpg
- WechatIMG57.jpg
- WechatIMG58.jpg
- WechatIMG59.jpg
- WechatIMG60.jpg
- WechatIMG61.jpg
- WechatIMG62.jpg
- WechatIMG63.jpg
- WechatIMG64.jpg
- WechatIMG65.jpg
- WechatIMG66.jpg
- WechatIMG67.jpg
- WechatIMG68.jpg
- WechatIMG69.jpg
- ADF-development-steps.md
- 41749428809_.pic_hd.jpg
- 51749429637_.pic_hd.jpg
- azure-data-factory-baseline.png
- azure-databricks-authentication-configuration.md
- azure-databricks-authentication-service-principal.md
- azure-databricks-cluster-pool.md
- azure-databricks-cluster-scoped-credentials.md
- azure-databricks-pricing-calc.md
- data-lakehouse-architecture.md
- databricks-cluster-configuration.md
- databricks-cluster.md
- databricks-utilities.md
- delta-lake-transcation-log.md
- lakehouse-3-layers-model.md
- mounting-data-lake-container-to-databricks.md
- solution-architecture.md
- README.md
- configuration.py
- 1.find_dominant_drivers.sql
- 2.find_dominant_teams.sql
- 3.viz_dominant_drivers.sql
- 4.viz_dominant_teams.sql
- 0.ingest_all_files.py
- 1.ingest_circuits_file.py
- 2.ingest_races_file.py
- 3.ingest_constructors_file.py
- 4.ingest_drivers_file.py
- 5.ingest_results_file.py
- 6.ingest_pit_stops_file.py
- 7.ingest_lap_times_file.py
- 8.ingest_qualifying_file.py
- create_presentation_database.sql
- drop_tables_presentation.sql
- create_processed_database.sql
- drop_tables_processed.sql
- create_raw_tables.sql
- 0.transform_all_files.py
- 1.race_results.py
- 2.driver_standings.py
- 3.constructor_standings.py
- 4.calculated_race_results.py
- 1.filter_demo.py
- 10.delta_lake_demo.py
- 2.join_demo.py
- 3.aggregation_demo.py
- 4.sql_temp_view_demo.py
- 5.sql_temp_view_demo.py
- 6.sql_objects_demo.sql
- 7.sql_basics_demo.sql
- 8.sql_functions_demo.sql
- 9.sql_joins_demo.sql
- cluster-config.png
- WechatIMG19.jpg
- WechatIMG20.jpg
- WechatIMG21.jpg
- WechatIMG23.jpg
- WechatIMG25.jpg
- WechatIMG26.jpg
- WechatIMG27.jpg
- WechatIMG28.jpg
- WechatIMG29.jpg
- WechatIMG30.jpg
- WechatIMG31.jpg
- WechatIMG32.jpg
- WechatIMG33.jpg
- WechatIMG35.jpg
- WechatIMG36.jpg
- WechatIMG38.jpg
- WechatIMG39.jpg
- WechatIMG41.jpg
- WechatIMG42.jpg
- WechatIMG43.jpg
- WechatIMG44.jpg
- WechatIMG45.jpg
- WechatIMG46.jpg
- WechatIMG70.jpg
- WechatIMG71.jpg
- WechatIMG72.jpg
- WechatIMG73.jpg
- WechatIMG74.jpg
- WechatIMG75.jpg
- common_functions.py
- export_delta_table.ipynb
- mount_adls_storage.py
- restore_data_in_ADLS.ipynb
- README.md
- calculated_race_results.csv
- constructor_standings.csv
- driver_standings.csv
- race_results.csv
- constructor_standings_output-1.png
- constructor_standings_output-2.png
- constructor_standings_output-3.png
- driver_standings_output-1.png
- driver_standings_output-2.png
- driver_standings_output-3.png
- driver_standings_output-4.png
- race_results_output-1.png
- race_results_output-2.png
- race_results_output-3.png
- race_results_output-4.png
- f1_presentation_analysis-checkpoint.ipynb
- f1_presentation_analysis.html
- f1_presentation_analysis.ipynb
- dashboard.twb
- Final Project Paper.pdf
- LICENSE
- README.md
// repository documentation
Was this content helpful?
(0 ratings)
