aiter

(β˜… 534)

AI Tensor Engine for ROCm

File Explorer

Download Latest Version (.zip)

Showing a partial file list β€” download the zip above to see everything.

  • .clang-format
  • .clang-tidy
  • .gitattributes
  • .gitignore
  • .gitmodules
  • CONTRIBUTE.md
  • LICENSE
  • MANIFEST.in
  • README.md
  • REPO_CLEANUP_PLAN.md

# Installation Guide

1. Get the code
git clone https://github.com/ROCm/aiter

Downloads the entire project code from GitHub to your computer.

cd aiter

Moves into the project folder you just downloaded.

2. Python

Easy Recommended
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.
pip install -r requirements.txt

Installs the Python libraries listed in requirements.txt (or similar).

pip install -e .

Installs the Python libraries listed in requirements.txt (or similar).

pip install -r requirements-triton-comms.txt

Installs the Python libraries listed in requirements.txt (or similar).

βœ… If it runs without errors and prints output in the terminal, it worked.

Pulled directly from this repo's README.

3. Make

Medium
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Make Usually pre-installed on Linux/macOS. On Windows, install separately (e.g. via MSYS2 or WSL).
⚠️ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.
cd csrc/cpp_itfs/mla

This project's files live in a subfolder, so move into it first.

make

Compiles the code based on the generated build configuration to produce an executable.

βœ… If it finishes without errors, it worked. Try running the generated executable directly.

Today's picks

react β˜… 247,300

The library for web and native user interfaces.

JavaScript
transformers β˜… 164,163

πŸ€— Transformers: the model-definition framework for state-of-the-art machine learning model

Python
v2rayN β˜… 113,981

A GUI client for Windows, Linux and macOS, support Xray and sing-box and others

C#
PaddleOCR β˜… 87,742

Turn any PDF or image document into structured data for your AI. A powerful, lightweight O

Python
tailwindcss β˜… 97,258

A utility-first CSS framework for rapid UI development.

TypeScript
codex β˜… 106,261

Lightweight coding agent that runs in your terminal

Rust
// repository documentation