modern-data-warehouse-dataops

(β˜… 710)

DataOps for Microsoft Data Platform technologies. https://aka.ms/dataops-repo

File Explorer

Download Latest Version (.zip)
  • .gitignore
  • .markdownlint.yml
  • .pre-commit-config.yaml
  • .yamllint.yaml
  • CODE_OF_CONDUCT.md
  • CONTRIBUTING.md
  • LICENSE
  • linkspector.yml
  • package-lock.json
  • pyproject.toml
  • README.md
  • SECURITY.md

πŸš€ Installation Guide

1. Get the code
git clone https://github.com/Azure-Samples/modern-data-warehouse-dataops

Downloads the entire project code from GitHub to your computer.

cd modern-data-warehouse-dataops

Moves into the project folder you just downloaded.

2. Docker

Easy Recommended
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker build -f archive/e2e_samples/parking_sensors_synapse/src/ddo_transform/Dockerfile -t modern-data-warehouse-dataops .

Builds a runnable image based on the Dockerfile.

docker run -p 8080:80 modern-data-warehouse-dataops

Runs the built image as an actual container.

βœ… Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.

3. .NET

Medium
Prerequisites
  • Git Needed to download the project code from GitHub.
  • .NET SDK The SDK required for the dotnet command.
cd archive/e2e_samples/deployment_stamps/api

This project's files live in a subfolder, so move into it first.

dotnet restore

Downloads the packages the project depends on.

dotnet run

Builds the project and runs it immediately.

βœ… After dotnet run, check the message or address shown in the terminal.

4. Node.js

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Node.js Node.js must be installed to use npm. The LTS version is recommended.
cd databricks/parking_sensors/adf

This project's files live in a subfolder, so move into it first.

npm install

Downloads and installs the libraries listed in package.json.

npm start

Starts the development/run server.

βœ… After running the command, open the address shown in the terminal (usually something like http://localhost:3000) in your browser.

5. Python

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.
pip install -r archive/e2e_samples/dataset_versioning/sql/data_generator/requirements.txt

Installs the Python libraries listed in requirements.txt (or similar).

jupyter notebook

Launches Jupyter in your browser so you can open and run the notebook (.ipynb) files.

βœ… If it runs without errors and prints output in the terminal, it worked.

6. Make

Medium
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Make Usually pre-installed on Linux/macOS. On Windows, install separately (e.g. via MSYS2 or WSL).
cd archive/e2e_samples/parking_sensors_synapse/src/ddo_transform

This project's files live in a subfolder, so move into it first.

make

Compiles the code based on the generated build configuration to produce an executable.

βœ… If it finishes without errors, it worked. Try running the generated executable directly.

Today's picks

godot β˜… 115,749

Godot Engine – Multi-platform 2D and 3D game engine

C++
Awesome-Hacking β˜… 118,448

A collection of various awesome lists for hackers, pentesters and security researchers
grafana β˜… 76,299

The open and composable observability and data visualization platform. Visualize metrics,

TypeScript
RuView β˜… 90,357

Ο€ RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign moni

Rust
pi β˜… 91,423

AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

TypeScript
rustdesk β˜… 120,987

An open-source remote desktop application designed for self-hosting, as an alternative to

Rust
// repository documentation