aicr

(β˜… 385)

Tooling for optimized, validated, and reproducible GPU-accelerated AI runtime in Kubernetes

Showing a partial file list β€” download the zip above to see everything.

  • .coderabbit.yaml
  • .ctlptl-kwok.yaml
  • .ctlptl.yaml
  • .dockerignore
  • .gitattributes
  • .gitignore
  • .go-version
  • .golangci.yaml
  • .goreleaser.yaml
  • .grype.yaml
  • .ko.yaml
  • .lychee.toml
  • .openvex.json
  • .settings.yaml
  • .yamllint.yaml
  • ADOPTERS.md
  • AGENTS.md
  • CHANGELOG.md
  • cliff.toml
  • CODE_OF_CONDUCT.md
  • CONTRIBUTING.md
  • DEVELOPMENT.md
  • go.mod
  • go.sum
  • GOVERNANCE.md
  • install
  • LICENSE
  • MAINTAINERS.md
  • Makefile
  • README.md
  • RELEASING.md
  • ROADMAP.md
  • SECURITY.md
  • THIRD_PARTY_NOTICES.md

# Installation Guide

1. Get the code
git clone https://github.com/NVIDIA/aicr

Downloads the entire project code from GitHub to your computer.

cd aicr

Moves into the project folder you just downloaded.

2. Official Install Script

Easy Recommended
Prerequisites
  • Homebrew A package manager for macOS/Linux.
brew tap NVIDIA/aicr

Registers this project's repository (tap) with Homebrew.

brew install aicr

Installs the pre-built package via Homebrew β€” no source build required.

βœ… After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.

Pulled directly from this repo's README.

3. Docker

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
⚠️ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.
docker build -f cmd/gate/Dockerfile -t aicr .

Builds a runnable image based on the Dockerfile.

docker run -p 8080:80 aicr

Runs the built image as an actual container.

βœ… Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.

4. Node.js

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Node.js Node.js must be installed to use npm. The LTS version is recommended.
⚠️ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.
cd tools/mdx

This project's files live in a subfolder, so move into it first.

npm install

Downloads and installs the libraries listed in package.json.

npm start

Starts the development/run server.

βœ… After running the command, open the address shown in the terminal (usually something like http://localhost:3000) in your browser.

5. Python

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.
⚠️ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.
pip install -r validators/performance/requirements.txt

Installs the Python libraries listed in requirements.txt (or similar).

python <μ‹€ν–‰ν•  파일λͺ…>.py # READMEμ—μ„œ μ •ν™•ν•œ μ‹€ν–‰ 파일λͺ…을 ν™•μΈν•˜μ„Έμš”

Runs the Python script (or module).

βœ… If it runs without errors and prints output in the terminal, it worked.

6. Go

Medium
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Go The Go compiler and toolchain.
go build ./...

Compiles the Go program into an executable.

go run .

Runs the Go program directly without a separate build step.

βœ… If the build finishes without errors, it worked. If you used go run ., check the terminal output.

7. Make

Medium
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Make Usually pre-installed on Linux/macOS. On Windows, install separately (e.g. via MSYS2 or WSL).
make

Compiles the code based on the generated build configuration to produce an executable.

βœ… If it finishes without errors, it worked. Try running the generated executable directly.
// repository documentation