llama-cpp-builder

KO | EN

gitlite — search

#hacktoberfest #ai #machine-learning #rust #deep-learning #linux #macos #nodejs #cli #kubernetes #awesome-list #pytorch #mcp #open-source

llama-cpp-builder

(★ 10)

Pre-built binary versions of llama.cpp for Ubuntu with CUDA and Vulkan support. Used by yzma.

llama-cpp-builder Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# llama.cpp Builder

## Prebuilt binaries for CUDA and Vulkan on Linux

This repo builds binary versions of `llama.cpp` libraries and executables for architectures that are not already part of the normal builds, such as Linux with CUDA or Vulkan support, and Linux arm64 CPU or Vulkan.

New releases are automatically built for the latest release version of `llama.cpp`. The latest release is checked once per hour.

[![yzma logo](https://raw.githubusercontent.com/hybridgroup/yzma/refs/heads/main/images/yzma-logo-full-color-small.png)](https://github.com/hybridgroup/yzma)

Used by [yzma](https://github.com/hybridgroup/yzma) installer. yzma lets you write Go applications that directly integrate the latest `llama.cpp` libraries.

## CUDA

Currently supported CUDA build configurations:

| CPU arch   | OS           | CUDA  | Nvidia Compute arch |
|--------|--------------|-------|---------|
| amd64  | Ubuntu 24.04      | 12.9  | 75, 80, 86, 89, 90  |
| amd64  | Ubuntu 24.04      | 13.0.88  | 75, 80, 86, 89, 90  |
| arm64  | Ubuntu 22.04      | 12.9  | 87  |
| arm64  | Ubuntu 22.04      | 13.0.88  | 87  |

Compute architectures `86` and `89` are those used by consumer video cards.

Compute architecture `87` is used by Jetson Orin and Jetson AGX.

## Vulkan

Currently supported Vulkan build configurations:

| CPU arch   | OS           | Vulkan  |
|--------|--------------|-------|
| arm64  | Ubuntu 22.04/Debian Bookworm | 1.4.328.1  |
| arm64  | Ubuntu 24.04/Debian Trixie | 1.4.328.1  |

The prebuilt Vulkan SDK for ARM64 used for our builds comes from https://github.com/jakoch/vulkan-sdk-arm

Thank you!

## CPU

Currently supported CPU build configurations:

| CPU arch   | OS           |
|--------|--------------|
| arm64  | Ubuntu 22.04/Debian Bookworm |
| arm64  | Ubuntu 24.04/Debian Trixie |

## How to check the latest version

```
VERSION=$(curl -s https://hybridgroup.github.io/llama-cpp-builder/version.json | jq -r '.tag_name')
```

llama-cpp-builder

llama-cpp-builder Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

llama-cpp-builder

llama-cpp-builder Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README