data-science-stack-cookiecutter

(โ˜… 215)

๐Ÿณ๐Ÿ“Š๐Ÿค“Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & API Star)

  • architecture.png
  • cookiecutter.json
  • LICENSE
  • README.md

# ์„ค์น˜ ๊ฐ€์ด๋“œ

1. ์ฝ”๋“œ ๋‚ด๋ ค๋ฐ›๊ธฐ
git clone https://github.com/jgoerner/data-science-stack-cookiecutter

๊นƒํ—ˆ๋ธŒ์—์„œ ํ”„๋กœ์ ํŠธ ์ฝ”๋“œ ์ „์ฒด๋ฅผ ๋‚ด ์ปดํ“จํ„ฐ๋กœ ๋‚ด๋ ค๋ฐ›์Šต๋‹ˆ๋‹ค.

cd data-science-stack-cookiecutter

๋ฐฉ๊ธˆ ๋‚ด๋ ค๋ฐ›์€ ํ”„๋กœ์ ํŠธ ํด๋” ์•ˆ์œผ๋กœ ์ด๋™ํ•ฉ๋‹ˆ๋‹ค.

2. Docker

์‰ฌ์›€ ์ถ”์ฒœ
์‚ฌ์ „ ์ค€๋น„๋ฌผ
  • Git GitHub์—์„œ ํ”„๋กœ์ ํŠธ ์ฝ”๋“œ๋ฅผ ๋‚ด๋ ค๋ฐ›์œผ๋ ค๋ฉด ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค.
  • Docker Desktop ์ปจํ…Œ์ด๋„ˆ๋ฅผ ๋นŒ๋“œํ•˜๊ณ  ์‹คํ–‰ํ•˜๋ ค๋ฉด ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค. ์„ค์น˜ ํ›„ ์‹คํ–‰ํ•ด์„œ ๋ฐฑ๊ทธ๋ผ์šด๋“œ์— ์ผœ๋‘์„ธ์š”.
docker compose -f {{cookiecutter.project_name}}/docker-compose.yml up -d --build

compose ์„ค์ • ํŒŒ์ผ์— ์ •์˜๋œ ์„œ๋น„์Šค๋“ค์„ ๋Œ€์ƒ์œผ๋กœ ๋ช…๋ น์„ ์‹คํ–‰ํ•ฉ๋‹ˆ๋‹ค.

โœ… ํ„ฐ๋ฏธ๋„์— docker compose ps ๋ฅผ ์ž…๋ ฅํ•ด ์ปจํ…Œ์ด๋„ˆ๋“ค์ด Up ์ƒํƒœ์ธ์ง€ ํ™•์ธํ•˜์„ธ์š”. README์— ํฌํŠธ ๋ฒˆํ˜ธ๊ฐ€ ์ ํ˜€์žˆ๋‹ค๋ฉด ๋ธŒ๋ผ์šฐ์ €์—์„œ http://localhost:ํฌํŠธ๋ฒˆํ˜ธ ๋กœ ์ ‘์†ํ•ด๋ณด์„ธ์š”.

3. Python

์‰ฌ์›€
์‚ฌ์ „ ์ค€๋น„๋ฌผ
  • Git GitHub์—์„œ ํ”„๋กœ์ ํŠธ ์ฝ”๋“œ๋ฅผ ๋‚ด๋ ค๋ฐ›์œผ๋ ค๋ฉด ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค.
  • Python 3 ์„ค์น˜ ์‹œ 'Add Python to PATH' ์˜ต์…˜์„ ๊ผญ ์ฒดํฌํ•˜์„ธ์š” (Windows).
โš ๏ธ ์ด ํ”„๋กœ์ ํŠธ๋Š” ๊ทœ๋ชจ๊ฐ€ ํฐ ์ €์žฅ์†Œ๋ผ, ์ด ๋ฐฉ๋ฒ•์ด ์‹ค์ œ ํ•ต์‹ฌ ์ œํ’ˆ์ด ์•„๋‹ˆ๋ผ ๋‚ด๋ถ€ ํ•˜์œ„ ํŒจํ‚ค์ง€๋ฅผ ๊ฐ€๋ฆฌํ‚ค๋Š” ๊ฒƒ์ผ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. README ์ „์ฒด๋ฅผ ํ•จ๊ป˜ ํ™•์ธํ•ด๋ณด์„ธ์š”.
pip install -r {{cookiecutter.project_name}}/shared/requirements.txt

requirements.txt ๋“ฑ์— ๋ช…์‹œ๋œ ํŒŒ์ด์ฌ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋ฅผ ์„ค์น˜ํ•ฉ๋‹ˆ๋‹ค.

jupyter notebook

๋ธŒ๋ผ์šฐ์ €์—์„œ ๋…ธํŠธ๋ถ(.ipynb) ํŒŒ์ผ๋“ค์„ ์—ด๋žŒํ•˜๊ณ  ์‹คํ–‰ํ•  ์ˆ˜ ์žˆ๋Š” Jupyter ํ™”๋ฉด์„ ์ผญ๋‹ˆ๋‹ค.

โœ… ์—๋Ÿฌ ๋ฉ”์‹œ์ง€ ์—†์ด ์‹คํ–‰๋˜๊ณ  ํ„ฐ๋ฏธ๋„์— ์•ˆ๋‚ด ๋ฌธ๊ตฌ๊ฐ€ ์ถœ๋ ฅ๋˜๋ฉด ์ •์ƒ์ž…๋‹ˆ๋‹ค.
// repository documentation