aikit
๐๏ธ Fine-tune, build, and deploy open-source LLMs easily!
ํ์ผ ํ์๊ธฐ
์ต์ข ๋ฒ์ ๋ค์ด๋ก๋ (.zip)- bug-report.yml
- feature-request.yml
- codeql.yml
- daily-test-improver.lock.yml
- daily-test-improver.md
- dependabot.yaml
- dependency-review.yml
- deploy-docs.yaml
- issue-triage.lock.yml
- issue-triage.md
- lint.yaml
- mirror-localai.yml
- patch-models.yaml
- pre-release.yaml
- release-base.yaml
- release-hf-cli.yaml
- release-pr.yaml
- release-runners.yaml
- release.yaml
- scorecards.yml
- test-docker-args.yaml
- test-docker-gpu.yaml
- test-docker-runner-gpu.yaml
- test-docker-runner.yaml
- test-docker.yaml
- test-finetune.yaml
- test-helm.yaml
- test-kubernetes.yaml
- test-local-context.yaml
- test-oci-platforms.yaml
- test-packager-inference.yaml
- test-packager.yaml
- test-podman-applesilicon.yaml
- unit-test.yaml
- update-models.yaml
- CODEOWNERS
- copilot-instructions.md
- dependabot.yaml
- PULL_REQUEST_TEMPLATE.md
- semantic.yml
- _helpers.tpl
- deployment.yaml
- hpa.yaml
- namespace-post-install.yaml
- NOTES.txt
- service.yaml
- Chart.yaml
- values.yaml
- main.go
- main_test.go
- main.go
- demo-magic.sh
- license.txt
- README.md
- demo.sh
- index.yaml
- resolutions.json
- availability.go
- generate.go
- generate_test.go
- policy.go
- policy_test.go
- resolver.go
- resolver_test.go
- source.go
- test_constants_test.go
- types.go
- aikitfile.yaml
- codestral-22b.yaml
- flux-1-dev.yaml
- gemma-2-2b-instruct.yaml
- gpt-oss-120b.yaml
- gpt-oss-20b.yaml
- llama-3.1-8b-instruct.yaml
- llama-3.2-1b-instruct.yaml
- llama-3.2-3b-instruct.yaml
- llama-3.3-70b-instruct.yaml
- mixtral-8x7b-instruct.yaml
- phi-4-14b-instruct.yaml
- qwq-32b.yaml
- finetune_specs.go
- inference_specs.go
- specs.go
- specs_test.go
- convert.go
- convert_test.go
- backend.go
- backend_test.go
- catalog.go
- convert.go
- convert_benchmark_test.go
- convert_test.go
- download.go
- image.go
- image_test.go
- optimization_test.go
- runner.go
- runner_test.go
- catalog.go
- catalog.lock.json
- catalog_test.go
- validate.go
- args.go
- build.go
- build_test.go
- platform_test.go
- pylock.toml
- requirements.in
- target.go
- target_unsloth.py
- test_target_unsloth.py
- uv-bootstrap.txt
- build.go
- build_helpers.go
- build_hf.go
- build_source.go
- build_templates.go
- build_templates_performance_test.go
- build_test.go
- const.go
- util.go
- util_test.go
- version.go
- diffusers-cuda.yaml
- llama-cpp-cpu.yaml
- llama-cpp-cuda.yaml
- vllm-cpp-cpu.yaml
- vllm-cpp-cuda.yaml
- vllm-cuda.yaml
- check-image-size.sh
- check-image-size_test.sh
- check-llb-benchmark.sh
- parse-models.sh
- update-unsloth-lock.sh
- local-model.gguf
- aikitfile.yaml
- max-local-context-transfer.jq
- predicate.json
- model.gguf
- model.gguf
- model.gguf
- multi-platform.aikitfile.yaml
- publish-fixtures.sh
- single-stamped.aikitfile.yaml
- alpaca-smoke.jsonl
- messages-response-smoke.jsonl
- messages-smoke.jsonl
- multiple-alpaca-smoke.jsonl
- multiple-text-smoke.jsonl
- preference-smoke.jsonl
- prompt-completion-loader-smoke.parquet
- prompt-completion-smoke.jsonl
- sharegpt-response-smoke.jsonl
- text-smoke.jsonl
- aikitfile-args.yaml
- aikitfile-dev.yaml
- aikitfile-diffusers.yaml
- aikitfile-flux-schnell.yaml
- aikitfile-hf.yaml
- aikitfile-llama-cpp.yaml
- aikitfile-llama-cuda.yaml
- aikitfile-llama-rocm.yaml
- aikitfile-llama.yaml
- aikitfile-llava.yaml
- aikitfile-oci.yaml
- aikitfile-parakeet-cpp.yaml
- aikitfile-piper.yaml
- aikitfile-rfdetr-cpp.yaml
- aikitfile-silero-vad.yaml
- aikitfile-transformers.yaml
- aikitfile-unsloth-adapter-smoke.yaml
- aikitfile-unsloth-custom.yaml
- aikitfile-unsloth-dpo-smoke.yaml
- aikitfile-unsloth-loader-smoke.yaml
- aikitfile-unsloth-messages-response-smoke.yaml
- aikitfile-unsloth-messages-smoke.yaml
- aikitfile-unsloth-multiple-datasets-smoke.yaml
- aikitfile-unsloth-prompt-completion-smoke.yaml
- aikitfile-unsloth-sharegpt-response-smoke.yaml
- aikitfile-unsloth-smoke.yaml
- aikitfile-unsloth-text-smoke.yaml
- aikitfile-unsloth.yaml
- aikitfile-vllm-cpp-cpu.yaml
- aikitfile-vllm-cpp-cuda.yaml
- aikitfile-vllm.yaml
- aikitfile-whisper.yaml
- architecture.md
- create-images.md
- demo.md
- diffusion.md
- fine-tune.md
- gpu.md
- intro.md
- kubernetes.md
- llama-cpp.md
- packaging.md
- premade-models.md
- quick-start.md
- release.md
- runners.md
- security.md
- specs-finetune.md
- specs-inference.md
- vision.md
- custom.css
- architecture.png
- favicon.ico
- logo.png
- logo.svg
- .nojekyll
- .gitignore
- babel.config.js
- docusaurus.config.js
- osv-scanner.toml
- package.json
- README.md
- sidebars.js
- yarn.lock
- .gitattributes
- .gitignore
- .golangci.yaml
- .pre-commit-config.yaml
- AGENTS.md
- CLAUDE.md
- CONTRIBUTING.md
- Dockerfile
- Dockerfile.base
- Dockerfile.base-applesilicon
- Dockerfile.hf-cli
- go.mod
- go.sum
- LICENSE
- Makefile
- README.md
- SECURITY.md
# ์ค์น ๊ฐ์ด๋
1. ์ฝ๋ ๋ด๋ ค๋ฐ๊ธฐ
git clone https://github.com/kaito-project/aikit
๊นํ๋ธ์์ ํ๋ก์ ํธ ์ฝ๋ ์ ์ฒด๋ฅผ ๋ด ์ปดํจํฐ๋ก ๋ด๋ ค๋ฐ์ต๋๋ค.
cd aikit
๋ฐฉ๊ธ ๋ด๋ ค๋ฐ์ ํ๋ก์ ํธ ํด๋ ์์ผ๋ก ์ด๋ํฉ๋๋ค.
2. Docker
์ฌ์ ์ถ์ฒ์ฌ์ ์ค๋น๋ฌผ
- Git GitHub์์ ํ๋ก์ ํธ ์ฝ๋๋ฅผ ๋ด๋ ค๋ฐ์ผ๋ ค๋ฉด ํ์ํฉ๋๋ค.
- Docker Desktop ์ปจํ ์ด๋๋ฅผ ๋น๋ํ๊ณ ์คํํ๋ ค๋ฉด ํ์ํฉ๋๋ค. ์ค์น ํ ์คํํด์ ๋ฐฑ๊ทธ๋ผ์ด๋์ ์ผ๋์ธ์.
docker run -d --rm -p 8080:8080 ghcr.io/kaito-project/aikit/llama3.1:8b
๋น๋๋ ์ด๋ฏธ์ง๋ฅผ ์ค์ ์ปจํ ์ด๋๋ก ์คํํฉ๋๋ค.
ํฐ๋ฏธ๋์ docker compose ps ๋ฅผ ์
๋ ฅํด ์ปจํ
์ด๋๋ค์ด Up ์ํ์ธ์ง ํ์ธํ์ธ์. README์ ํฌํธ ๋ฒํธ๊ฐ ์ ํ์๋ค๋ฉด ๋ธ๋ผ์ฐ์ ์์ http://localhost:ํฌํธ๋ฒํธ ๋ก ์ ์ํด๋ณด์ธ์.
์ด ๋ ํฌ์ README์ ์ ํ ์ค์ ๋ช ๋ น์ด๋ฅผ ๊ทธ๋๋ก ๊ฐ์ ธ์์ต๋๋ค.
3. Go
๋ณดํต์ฌ์ ์ค๋น๋ฌผ
go build ./...
Go ํ๋ก๊ทธ๋จ์ ์ปดํ์ผํด ์คํ ํ์ผ์ ๋ง๋ญ๋๋ค.
go run .
๋ฐ๋ก ๋น๋ํ์ง ์๊ณ ๋ฐ๋ก Go ํ๋ก๊ทธ๋จ์ ์คํํฉ๋๋ค.
๋น๋๊ฐ ์๋ฌ ์์ด ๋๋๋ฉด ์ฑ๊ณต์
๋๋ค. go run . ์ ์ผ๋ค๋ฉด ํฐ๋ฏธ๋ ์ถ๋ ฅ์ ํ์ธํ์ธ์.
4. Make
๋ณดํต์ฌ์ ์ค๋น๋ฌผ
- Git GitHub์์ ํ๋ก์ ํธ ์ฝ๋๋ฅผ ๋ด๋ ค๋ฐ์ผ๋ ค๋ฉด ํ์ํฉ๋๋ค.
- Make Linux/macOS๋ ๋ณดํต ๊ธฐ๋ณธ ์ค์น๋์ด ์์ต๋๋ค. Windows๋ ๋ณ๋ ์ค์น(์: MSYS2, WSL)๊ฐ ํ์ํฉ๋๋ค.
make
์์ฑ๋ ๋น๋ ์ค์ ์ ๋ฐํ์ผ๋ก ์ค์ ์ปดํ์ผ์ ์งํํด ์คํ ํ์ผ์ ๋ง๋ญ๋๋ค.
์๋ฌ ์์ด ๋๋๋ฉด ์ฑ๊ณต์
๋๋ค. ์์ฑ๋ ์คํ ํ์ผ์ ์ง์ ์คํํด๋ณด์ธ์.
// repository documentation
Was this content helpful?
(0 ratings)
