candle

(★ 20,937)

Rust를 위한 미니멀리스트 ML 프레임워크

파일 탐색기

최종 버전 다운로드 (.zip)

- config.toml
- - ci_cuda.yaml
  - maturin.yml
  - python.yml
  - rust-ci.yml
  - trufflehog.yml
- dependabot.yml
- - chapter_1.md
  - error_manage.md
  - lib.rs
  - README.md
  - simplified.rs
  - SUMMARY.md
  - tracing.md
- .gitignore
- book.toml
- Cargo.toml
- CONTRIBUTING.md
- - bench_main.rs
- - basics.rs
  - cuda_basics.rs
  - cuda_sum_benchmark.rs
  - metal_basics.rs
- - accelerate.rs
  - backend.rs
  - backprop.rs
  - conv.rs
  - convert.rs
  - custom_op.rs
  - device.rs
  - display.rs
  - dtype.rs
  - dummy_cuda_backend.rs
  - dummy_dtype.rs
  - dummy_metal_backend.rs
  - error.rs
  - indexer.rs
  - layout.rs
  - lib.rs
  - mkl.rs
  - nditer.rs
  - npy.rs
  - op.rs
  - pickle.rs
  - safetensors.rs
  - scalar.rs
  - shape.rs
  - sort.rs
  - storage.rs
  - streaming.rs
  - strided_index.rs
  - tensor.rs
  - tensor_cat.rs
  - test_utils.rs
  - utils.rs
  - variable.rs
- - bilinear_tests.rs
  - conv_tests.rs
  - custom_op_tests.rs
  - display_tests.rs
  - fortran_tensor_3d.pth
  - gguf_tests.rs
  - grad_tests.rs
  - indexing_tests.rs
  - layout_tests.rs
  - matmul_tests.rs
  - metal_concurrent_tests.rs
  - npy.py
  - pool_tests.rs
  - pth.py
  - pth_tests.rs
  - quantized_tests.rs
  - serialization_tests.rs
  - tensor_tests.rs
  - test.npy
  - test.npz
  - test.pt
  - test_with_key.pt
- Cargo.toml
- LICENSE
- README.md
- - batcher.rs
  - hub.rs
  - lib.rs
- Cargo.toml
- README.md
- - gguf-tokenizer.rs
  - onnx_basics.rs
- - audio.rs
  - bs1770.rs
  - chat_template.rs
  - coco_classes.rs
  - imagenet.rs
  - lib.rs
  - token_output_stream.rs
  - wav.rs
- build.rs
- buildtime_downloader.rs
- Cargo.toml
- README.md
- - alibi.h
  - block_info.h
  - dropout.h
  - error.h
  - flash.h
  - flash_api.cu
  - flash_fwd_hdim128_bf16_causal_sm80.cu
  - flash_fwd_hdim128_bf16_sm80.cu
  - flash_fwd_hdim128_fp16_causal_sm80.cu
  - flash_fwd_hdim128_fp16_sm80.cu
  - flash_fwd_hdim160_bf16_causal_sm80.cu
  - flash_fwd_hdim160_bf16_sm80.cu
  - flash_fwd_hdim160_fp16_causal_sm80.cu
  - flash_fwd_hdim160_fp16_sm80.cu
  - flash_fwd_hdim192_bf16_causal_sm80.cu
  - flash_fwd_hdim192_bf16_sm80.cu
  - flash_fwd_hdim192_fp16_causal_sm80.cu
  - flash_fwd_hdim192_fp16_sm80.cu
  - flash_fwd_hdim224_bf16_causal_sm80.cu
  - flash_fwd_hdim224_bf16_sm80.cu
  - flash_fwd_hdim224_fp16_causal_sm80.cu
  - flash_fwd_hdim224_fp16_sm80.cu
  - flash_fwd_hdim256_bf16_causal_sm80.cu
  - flash_fwd_hdim256_bf16_sm80.cu
  - flash_fwd_hdim256_fp16_causal_sm80.cu
  - flash_fwd_hdim256_fp16_sm80.cu
  - flash_fwd_hdim32_bf16_causal_sm80.cu
  - flash_fwd_hdim32_bf16_sm80.cu
  - flash_fwd_hdim32_fp16_causal_sm80.cu
  - flash_fwd_hdim32_fp16_sm80.cu
  - flash_fwd_hdim512_bf16_causal_sm80.cu
  - flash_fwd_hdim512_bf16_sm80.cu
  - flash_fwd_hdim512_fp16_causal_sm80.cu
  - flash_fwd_hdim512_fp16_sm80.cu
  - flash_fwd_hdim64_bf16_causal_sm80.cu
  - flash_fwd_hdim64_bf16_sm80.cu
  - flash_fwd_hdim64_fp16_causal_sm80.cu
  - flash_fwd_hdim64_fp16_sm80.cu
  - flash_fwd_hdim96_bf16_causal_sm80.cu
  - flash_fwd_hdim96_bf16_sm80.cu
  - flash_fwd_hdim96_fp16_causal_sm80.cu
  - flash_fwd_hdim96_fp16_sm80.cu
  - flash_fwd_kernel.h
  - flash_fwd_launch_template.h
  - flash_fwd_splitkv_hdim128_bf16_causal_sm80.cu
  - flash_fwd_splitkv_hdim128_bf16_sm80.cu
  - flash_fwd_splitkv_hdim128_fp16_causal_sm80.cu
  - flash_fwd_splitkv_hdim128_fp16_sm80.cu
  - flash_fwd_splitkv_hdim256_bf16_causal_sm80.cu
  - flash_fwd_splitkv_hdim256_bf16_sm80.cu
  - flash_fwd_splitkv_hdim256_fp16_causal_sm80.cu
  - flash_fwd_splitkv_hdim256_fp16_sm80.cu
  - flash_fwd_splitkv_hdim512_bf16_causal_sm80.cu
  - flash_fwd_splitkv_hdim512_bf16_sm80.cu
  - flash_fwd_splitkv_hdim512_fp16_causal_sm80.cu
  - flash_fwd_splitkv_hdim512_fp16_sm80.cu
  - flash_fwd_splitkv_hdim64_bf16_causal_sm80.cu
  - flash_fwd_splitkv_hdim64_bf16_sm80.cu
  - flash_fwd_splitkv_hdim64_fp16_causal_sm80.cu
  - flash_fwd_splitkv_hdim64_fp16_sm80.cu
  - hardware_info.h
  - kernel_helpers.h
  - kernel_traits.h
  - kernel_traits_sm90.h
  - kernels.h
  - mask.h
  - philox.cuh
  - rotary.h
  - softmax.h
  - static_switch.h
  - utils.h
- - ffi.rs
  - lib.rs
- - flash_attn_tests.rs
- build.rs
- Cargo.toml
- README.md
- - combine.h
  - copy_paged_sm90_tma.hpp
  - copy_paged_sm90_tma_cutlass35.hpp
  - copy_paged_sm90_tma_cutlass36.hpp
  - epilogue_fwd_sm90_tma.hpp
  - flash.h
  - flash_api.cpp
  - flash_api.cu
  - flash_fwd_hdim128_bf16_gqa16_sm90.cu
  - flash_fwd_hdim128_bf16_gqa2_sm90.cu
  - flash_fwd_hdim128_bf16_gqa32_sm90.cu
  - flash_fwd_hdim128_bf16_gqa4_sm90.cu
  - flash_fwd_hdim128_bf16_gqa8_sm90.cu
  - flash_fwd_hdim128_bf16_sm90.cu
  - flash_fwd_hdim128_e4m3_gqa16_sm90.cu
  - flash_fwd_hdim128_e4m3_gqa2_sm90.cu
  - flash_fwd_hdim128_e4m3_gqa32_sm90.cu
  - flash_fwd_hdim128_e4m3_gqa4_sm90.cu
  - flash_fwd_hdim128_e4m3_gqa8_sm90.cu
  - flash_fwd_hdim128_e4m3_sm90.cu
  - flash_fwd_hdim128_fp16_gqa16_sm90.cu
  - flash_fwd_hdim128_fp16_gqa2_sm90.cu
  - flash_fwd_hdim128_fp16_gqa32_sm90.cu
  - flash_fwd_hdim128_fp16_gqa4_sm90.cu
  - flash_fwd_hdim128_fp16_gqa8_sm90.cu
  - flash_fwd_hdim128_fp16_sm90.cu
  - flash_fwd_hdim256_bf16_gqa16_sm90.cu
  - flash_fwd_hdim256_bf16_gqa2_sm90.cu
  - flash_fwd_hdim256_bf16_gqa32_sm90.cu
  - flash_fwd_hdim256_bf16_gqa4_sm90.cu
  - flash_fwd_hdim256_bf16_gqa8_sm90.cu
  - flash_fwd_hdim256_bf16_sm90.cu
  - flash_fwd_hdim256_e4m3_gqa16_sm90.cu
  - flash_fwd_hdim256_e4m3_gqa2_sm90.cu
  - flash_fwd_hdim256_e4m3_gqa32_sm90.cu
  - flash_fwd_hdim256_e4m3_gqa4_sm90.cu
  - flash_fwd_hdim256_e4m3_gqa8_sm90.cu
  - flash_fwd_hdim256_e4m3_sm90.cu
  - flash_fwd_hdim256_fp16_gqa16_sm90.cu
  - flash_fwd_hdim256_fp16_gqa2_sm90.cu
  - flash_fwd_hdim256_fp16_gqa32_sm90.cu
  - flash_fwd_hdim256_fp16_gqa4_sm90.cu
  - flash_fwd_hdim256_fp16_gqa8_sm90.cu
  - flash_fwd_hdim256_fp16_sm90.cu
  - flash_fwd_hdim512_bf16_gqa16_sm90.cu
  - flash_fwd_hdim512_bf16_gqa2_sm90.cu
  - flash_fwd_hdim512_bf16_gqa32_sm90.cu
  - flash_fwd_hdim512_bf16_gqa4_sm90.cu
  - flash_fwd_hdim512_bf16_gqa8_sm90.cu
  - flash_fwd_hdim512_bf16_sm90.cu
  - flash_fwd_hdim512_fp16_gqa16_sm90.cu
  - flash_fwd_hdim512_fp16_gqa2_sm90.cu
  - flash_fwd_hdim512_fp16_gqa32_sm90.cu
  - flash_fwd_hdim512_fp16_gqa4_sm90.cu
  - flash_fwd_hdim512_fp16_gqa8_sm90.cu
  - flash_fwd_hdim512_fp16_sm90.cu
  - flash_fwd_hdim64_bf16_gqa16_sm90.cu
  - flash_fwd_hdim64_bf16_gqa2_sm90.cu
  - flash_fwd_hdim64_bf16_gqa32_sm90.cu
  - flash_fwd_hdim64_bf16_gqa4_sm90.cu
  - flash_fwd_hdim64_bf16_gqa8_sm90.cu
  - flash_fwd_hdim64_bf16_sm90.cu
  - flash_fwd_hdim64_e4m3_gqa16_sm90.cu
  - flash_fwd_hdim64_e4m3_gqa2_sm90.cu
  - flash_fwd_hdim64_e4m3_gqa32_sm90.cu
  - flash_fwd_hdim64_e4m3_gqa4_sm90.cu
  - flash_fwd_hdim64_e4m3_gqa8_sm90.cu
  - flash_fwd_hdim64_e4m3_sm90.cu
  - flash_fwd_hdim64_fp16_gqa16_sm90.cu
  - flash_fwd_hdim64_fp16_gqa2_sm90.cu
  - flash_fwd_hdim64_fp16_gqa32_sm90.cu
  - flash_fwd_hdim64_fp16_gqa4_sm90.cu
  - flash_fwd_hdim64_fp16_gqa8_sm90.cu
  - flash_fwd_hdim64_fp16_sm90.cu
  - flash_fwd_kernel.h
  - flash_fwd_launch_template.h
  - kernel_traits.h
  - mainloop_fwd_sm90_tma_gmma_ws.hpp
  - named_barrier.hpp
  - seq_len.h
  - softmax.h
  - static_switch.h
  - tile_scheduler.hpp
  - utils.h
- - ffi.rs
  - lib.rs
- - flash_attn_tests.rs
- build.rs
- Cargo.toml
- README.md
- - affine.cu
  - binary.cu
  - binary_op_macros.cuh
  - cast.cu
  - compatibility.cuh
  - conv.cu
  - cuda_utils.cuh
  - ffi.rs
  - fill.cu
  - indexing.cu
  - lib.rs
  - mmvq_gguf.cu
  - ptx.rs
  - quantized.cu
  - reduce.cu
  - sort.cu
  - ternary.cu
  - unary.cu
- build.rs
- Cargo.toml
- README.md
- - metal_benchmarks.rs
- - err.rs
  - kernel.rs
  - lib.rs
  - source.rs
  - tests.rs
  - utils.rs
- Cargo.toml
- README.md
- - bench_main.rs
- - basic_optimizer.rs
  - cpu_benchmarks.rs
- - activation.rs
  - batch_norm.rs
  - conv.rs
  - cpu_flash_attention.rs
  - embedding.rs
  - encoding.rs
  - func.rs
  - group_norm.rs
  - init.rs
  - kv_cache.rs
  - layer_norm.rs
  - lib.rs
  - linear.rs
  - loss.rs
  - moe.rs
  - ops.rs
  - optim.rs
  - rnn.rs
  - rotary_emb.rs
  - sampling.rs
  - sequential.rs
  - var_builder.rs
  - var_map.rs
- - batch_norm.rs
  - cpu_flash_attn.rs
  - group_norm.rs
  - kv_cache.rs
  - layer_norm.rs
  - loss.rs
  - one_hot.rs
  - ops.rs
  - optim.rs
  - rnn.rs
  - sdpa.rs
  - varlen_flash_attention.rs
- Cargo.toml
- README.md
- - eval.rs
  - lib.rs
  - onnx.proto3
- - ops.rs
- build.rs
- Cargo.toml
- README.md
- - __init__.py
  - README.md
- - lib.rs
  - onnx.rs
  - shape.rs
  - utils.rs
- - __init__.py
- .gitignore
- build.rs
- Cargo.toml
- e5.py
- pyproject.toml
- quant-llama.py
- README.md
- stub.py
- test.py
- test_pytorch.py
- - fused_moe.rs
  - lib.rs
  - object_detection.rs
  - quantized_nn.rs
  - quantized_var_builder.rs
  - utils.rs
- - generation_tests.rs
  - nms_tests.rs
- Cargo.toml
- README.md
- - lib.rs
- Cargo.toml
- - bertWorker.js
  - build-lib.sh
  - Cargo.toml
  - lib-example.html
  - README.md
  - utils.js
- - blipWorker.js
  - build-lib.sh
  - Cargo.toml
  - index.html
  - README.md
- - Cargo.toml
  - README.md
- - build-lib.sh
  - Cargo.toml
  - index.html
  - lib-example.html
  - llama2cWorker.js
  - README.md
- - build-lib.sh
  - Cargo.toml
  - code.js
  - index.html
  - moondreamWorker.js
  - README.md
- - build-lib.sh
  - Cargo.toml
  - index.html
  - phiWorker.js
  - README.md
- - Cargo.toml
  - index.html
  - README.md
  - serve.py
- - build-lib.sh
  - Cargo.toml
  - lib-example.html
  - README.md
  - samWorker.js
- - build-lib.sh
  - Cargo.toml
  - index.html
  - README.md
  - T5ModelConditionalGeneration.js
  - T5ModelEncoderWorker.js
  - utils.js
- - build-lib.sh
  - Cargo.toml
  - index.html
  - lib-example.html
  - main.js
  - README.md
  - whisperWorker.js
- - build-lib.sh
  - Cargo.toml
  - index.html
  - lib-example.html
  - README.md
  - yoloWorker.js
- - lib.rs
- - quantized_tests.rs
- Cargo.toml
- README.md
- webdriver.json
- - main.rs
- Cargo.toml
.gitignore
.pre-commit-config.yaml
Cargo.toml
CHANGELOG.md
LICENSE-APACHE
LICENSE-MIT
Makefile
README.md

🚀 설치 가이드

1. 코드 내려받기

git clone https://github.com/huggingface/candle

깃허브에서 프로젝트 코드 전체를 내 컴퓨터로 내려받습니다.

cd candle

방금 내려받은 프로젝트 폴더 안으로 이동합니다.

2. 공식 설치 스크립트

쉬움 추천

사전 준비물

APT (Debian/Ubuntu 계열) Debian/Ubuntu 계열 리눅스에 기본 내장된 패키지 매니저입니다.

apt-get install -y curl git ca-certificates;

APT 패키지 저장소에서 바로 설치합니다 (Debian/Ubuntu 계열).

✅ 설치 후 새 터미널을 열고, 프로그램의 버전 확인 명령(예: --version)으로 정상 설치됐는지 확인하세요.

이 레포의 README에 적힌 실제 명령어를 그대로 가져왔습니다.

3. Python

쉬움

사전 준비물

Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
Python 3 설치 시 'Add Python to PATH' 옵션을 꼭 체크하세요 (Windows).

pip install -r candle-examples/examples/marian-mt/python/requirements.txt

requirements.txt 등에 명시된 파이썬 라이브러리를 설치합니다.

python <실행할 파일명>.py # README에서 정확한 실행 파일명을 확인하세요

파이썬 스크립트(또는 모듈)를 실행합니다.

✅ 에러 메시지 없이 실행되고 터미널에 안내 문구가 출력되면 정상입니다.

4. Rust

보통

사전 준비물

Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
Rust (rustup) rustup으로 설치하면 cargo도 함께 설치됩니다.

cargo run --example quantized --release

빌드 후 바로 실행까지 진행합니다.

= note: use the `cargo:rustc-link-lib` directive to specify the native libraries to link with Cargo

이 명령어를 터미널에 그대로 입력해 실행하세요.

RUN cargo build --release features cuda

Rust 프로젝트를 컴파일합니다.

env NVCC_CCBIN=/usr/lib/gcc/x86_64-linux-gnu/10 cargo ...

이 명령어를 터미널에 그대로 입력해 실행하세요.

-L native=$env:USERPROFILE\.cargo\registry\src\index.crates.io-6f17d22bba15001f\windows_x86_64_msvc-0.42.2\lib `

이 명령어를 터미널에 그대로 입력해 실행하세요.

✅ cargo build가 에러 없이 끝나면 성공입니다. target/ 폴더에 실행 파일이 생성됩니다.

이 레포의 README에 적힌 실제 명령어를 그대로 가져왔습니다.

5. Make

보통

사전 준비물

Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
Make Linux/macOS는 보통 기본 설치되어 있습니다. Windows는 별도 설치(예: MSYS2, WSL)가 필요합니다.

make

생성된 빌드 설정을 바탕으로 실제 컴파일을 진행해 실행 파일을 만듭니다.

✅ 에러 없이 끝나면 성공입니다. 생성된 실행 파일을 직접 실행해보세요.

candle

파일 탐색기

🚀 설치 가이드

2. 공식 설치 스크립트

3. Python

4. Rust

5. Make

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

candle

파일 탐색기

🚀 설치 가이드

2. 공식 설치 스크립트

3. Python

4. Rust

5. Make

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README