streamify

(β˜… 897)

A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!

File Explorer

Download Latest Version (.zip)
  • .gitignore
  • README.md
  • requirements.txt

# Installation Guide

1. Get the code
git clone https://github.com/ankurchavda/streamify

Downloads the entire project code from GitHub to your computer.

cd streamify

Moves into the project folder you just downloaded.

2. Docker

Easy Recommended
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker compose -f airflow/docker-compose.yaml up -d --build

Runs the command against the services defined in the compose file.

βœ… Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.

3. Python

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.
pip install -r airflow/requirements.txt

Installs the Python libraries listed in requirements.txt (or similar).

python <μ‹€ν–‰ν•  파일λͺ…>.py # READMEμ—μ„œ μ •ν™•ν•œ μ‹€ν–‰ 파일λͺ…을 ν™•μΈν•˜μ„Έμš”

Runs the Python script (or module).

βœ… If it runs without errors and prints output in the terminal, it worked.

Today's picks

SecLists β˜… 72,972

SecLists is the security tester's companion. It's a collection of multiple types of lists

PHP
skills β˜… 170,812

Public repository for Agent Skills

Python
codex β˜… 110,839

Lightweight coding agent that runs in your terminal

Rust
firecrawl β˜… 170,391

The context API to search, scrape, and interact with the web at scale. πŸ”₯

TypeScript
rustdesk β˜… 121,416

An open-source remote desktop application designed for self-hosting, as an alternative to

Rust
awesome-interview-questions β˜… 84,141

:octocat: A curated awesome list of lists of interview questions. Feel free to contribute!
// repository documentation