aiter

(β˜… 534)

AI Tensor Engine for ROCm

File Explorer

Download Latest Version (.zip)

Showing a partial file list β€” download the zip above to see everything.

  • .clang-format
  • .clang-tidy
  • .gitattributes
  • .gitignore
  • .gitmodules
  • CONTRIBUTE.md
  • LICENSE
  • MANIFEST.in
  • README.md
  • REPO_CLEANUP_PLAN.md

πŸš€ Installation Guide

1. Get the code
git clone https://github.com/ROCm/aiter

Downloads the entire project code from GitHub to your computer.

cd aiter

Moves into the project folder you just downloaded.

2. Docker

Easy Recommended
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker build -f docs/examples/isa_optimization/Dockerfile -t aiter .

Builds a runnable image based on the Dockerfile.

docker run -p 8080:80 aiter

Runs the built image as an actual container.

βœ… Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.

3. Python

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.
pip install -r requirements.txt

Installs the Python libraries listed in requirements.txt (or similar).

pip install -e .

Installs the Python libraries listed in requirements.txt (or similar).

pip install -r requirements-triton-comms.txt

Installs the Python libraries listed in requirements.txt (or similar).

βœ… If it runs without errors and prints output in the terminal, it worked.

Pulled directly from this repo's README.

4. Make

Medium
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Make Usually pre-installed on Linux/macOS. On Windows, install separately (e.g. via MSYS2 or WSL).
cd csrc/cpp_itfs/mla

This project's files live in a subfolder, so move into it first.

make

Compiles the code based on the generated build configuration to produce an executable.

βœ… If it finishes without errors, it worked. Try running the generated executable directly.

Today's picks

axios β˜… 109,204

Promise based HTTP client for the browser and node.js

JavaScript
awesome-mcp-servers β˜… 92,434

A collection of MCP servers.
andrej-karpathy-skills β˜… 203,052

A single CLAUDE.md file to improve Claude Code behavior, derived from Andrej Karpathy's ob
localsend β˜… 88,488

An open-source cross-platform alternative to AirDrop

Dart
go β˜… 135,806

The Go programming language

Go
tauri β˜… 110,269

Build smaller, faster, and more secure desktop and mobile applications with a web frontend

Rust
// repository documentation