Real-Time-Streaming-with-Azure-Databricks

KO | EN

gitlite — search

#python #react #ai #go #golang #android #deep-learning #nodejs #awesome #cli #awesome-list #vue #pytorch #security

Real-Time-Streaming-with-Azure-Databricks

(★ 20)

No description available.

Real-Time-Streaming-with-Azure-Databricks 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Real-Time-Streaming-with-Azure-Databricks

## Project Overview
Welcome to the "Real-Time Streaming with Azure Databricks" repository. This project demonstrates an end-to-end solution for real-time data streaming and analysis using Azure Databricks and Azure Event Hubs, with visualization in Power BI. It's an in-depth guide covering the setup, configuration, and implementation of a streaming data pipeline following the medallion architecture.

## Getting Started
To get started with this project, clone the repository and follow the guidance provided in this YouTube tutorial.

## Repository Contents
- `Real-time Data Processing with Azure Databricks (and Event Hubs).ipynb`: The Databricks notebook used for data processing at each layer of the medallion architecture.
- `data.txt`: Contains sample data and JSON structures for streaming simulation.
- `Azure Solution Architecture.png`: High level solution architecture.

## Prerequisites
- Active Azure subscription with access to Azure Databricks and Event Hubs.
- Databricks Workspace with Unity Catalog Enabled.
- Azure Event Hubs Service.
- Power BI Desktop (Windows).
- Familiarity with Python, Spark, SQL, and basic data engineering concepts.

Real-Time-Streaming-with-Azure-Databricks

Real-Time-Streaming-with-Azure-Databricks 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Real-Time-Streaming-with-Azure-Databricks

Real-Time-Streaming-with-Azure-Databricks 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README