airflow_in_docker_compose

(★ 185)

Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)

File Explorer

Download Latest Version (.zip)

- - test_dag.py
  - test_dependency.py
- - airflow.cfg
  - airflow_celeryexecutor.cfg
  - docker-compose-celery-executor.yml
  - docker-compose-volume-packages.yml
  - docker-compose.yml
  - Dockerfile
  - packages.pth
- docker-compose-v1-with-celery-executor.yml
- - 2.0.png
  - flower.png
  - main.png
  - version.png
.dockerignore
.env
.gitignore
docker-compose-with-celery-executor-2-workers.yml
docker-compose.yml
LICENSE
poetry.lock
pyproject.toml
README.md

# Installation Guide

1. Get the code

git clone https://github.com/xnuinside/airflow_in_docker_compose

Downloads the entire project code from GitHub to your computer.

cd airflow_in_docker_compose

Moves into the project folder you just downloaded.

2. Docker

Easy Recommended

Prerequisites

Git Needed to download the project code from GitHub.
Docker Desktop Needed to build and run containers. Install it and keep it running in the background.

docker-compose -f docker-compose-2.0-with-celery-executor.yml up --build

Runs the command against the services defined in the compose file.

docker-compose up --build

Runs the command against the services defined in the compose file.

In normal behaviour - in docker-compose I added autorestarts so after 10-15 secs all servers will be up&run, but sometimes 3 retries can be not enough.

Runs the command against the services defined in the compose file.

Those articles was created before release of official Apache Airflow Docker image and they use puckel/docker-airflow.

Type this command into your terminal and run it.

Now, already exist official image apache/airflow. So this docker-compose files became 'legacy'

Runs the command against the services defined in the compose file.

✅ Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.

Pulled directly from this repo's README.

3. Python

Easy

Prerequisites

Git Needed to download the project code from GitHub.
Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.

pip install .

Installs the package published on PyPI directly — no need to clone the source.

python <실행할 파일명>.py # README에서 정확한 실행 파일명을 확인하세요

Runs the Python script (or module).

✅ If it runs without errors and prints output in the terminal, it worked.