reame
CPU-first LLM inference server on llama.cpp. Runs useful models on free-tier ARM boxes; rewriting the input made it ~6x faster and more accurate than tuning the engine. MIT, benchmarks and failures included.
File Explorer
Download Latest Version (.zip)- ci.yml
- release.yml
- FUNDING.yml
- answer_type.py
- assenza.py
- bench_palimpsest.py
- embedder_e5.py
- esame_cascata.py
- fusione.py
- grounding.py
- make_paraphrased.py
- misura_esperimento.py
- misura_selettore.py
- page_compressed.txt
- page_factsheet.txt
- page_prose.txt
- palimpsest-ab.json
- paraphrases_factsheet.jsonl
- questions.jsonl
- questions_absent.jsonl
- questions_composite.jsonl
- questions_paraphrased.jsonl
- README.md
- retrieval.py
- run_fact_exam.py
- selettore.py
- speculazione-ab.json
- test_answer_type.py
- test_assenza.py
- test_corretta.py
- test_fusione.py
- test_grounding.py
- test_parafrasi.py
- test_questions_absent.py
- test_retrieval.py
- test_selettore.py
- CompilerFlags.cmake
- reame.conf
- avatar-512.png
- architecture.svg
- caso-uso.svg
- concierge-cascata.svg
- cucina-per-modello.png
- demo.gif
- due-motori.svg
- logo.svg
- mark.svg
- potatura-decode.png
- prefix-cache.svg
- speculative.svg
- ttft-per-forma.png
- velocita-per-modello.png
- warm-ahead.svg
- BENCHMARKS.md
- demo.tape
- README.it.md
- archive.hpp
- client.hpp
- resp.hpp
- server.hpp
- cache_manager.hpp
- cache_serializer.hpp
- disk_cache_store.hpp
- prefix_cache.hpp
- arca_cache.hpp
- autoconfig.hpp
- conclave.hpp
- engine.hpp
- llama_backend.hpp
- model.hpp
- nucleo_backend.hpp
- sampler.hpp
- scheduler.hpp
- corpus_index.hpp
- api_handler.hpp
- escalation.hpp
- http_server.hpp
- http_types.hpp
- acceptance.hpp
- batch_verifier.hpp
- draft_generator.hpp
- form_draft.hpp
- prompt_lookup.hpp
- speculative_decoder.hpp
- config.hpp
- logger.hpp
- version.hpp
- download_models.sh
- sartoria.sh
- archive.cpp
- client.cpp
- resp.cpp
- server.cpp
- cache_manager.cpp
- cache_serializer.cpp
- disk_cache_store.cpp
- prefix_cache.cpp
- .gitkeep
- autoconfig.cpp
- conclave.cpp
- engine.cpp
- llama_backend_real.cpp
- llama_backend_stub.cpp
- model.cpp
- nucleo_backend.cpp
- sampler.cpp
- scheduler.cpp
- .gitkeep
- corpus_index.cpp
- api_handler.cpp
- escalation.cpp
- http_parser.cpp
- http_server.cpp
- acceptance.cpp
- batch_verifier.cpp
- draft_generator.cpp
- form_draft.cpp
- prompt_lookup.cpp
- speculative_decoder.cpp
- config.cpp
- logger.cpp
- version.cpp
- CMakeLists.txt
- main.cpp
- llama_mock.hpp
- test_api_handler.cpp
- test_arca.cpp
- test_arca_client.cpp
- test_arca_server.cpp
- test_autoconfig.cpp
- test_cache.cpp
- test_conclave.cpp
- test_config.cpp
- test_corpus_index.cpp
- test_engine.cpp
- test_escalation.cpp
- test_form_draft.cpp
- test_http_parser.cpp
- test_http_server.cpp
- test_logger.cpp
- test_model.cpp
- test_nucleo_backend.cpp
- test_prefix_cache.cpp
- test_prompt_lookup.cpp
- test_resp.cpp
- test_sampler.cpp
- test_scheduler.cpp
- test_speculative.cpp
- test_version.cpp
- CMakeLists.txt
- llama.cpp
- reame-concierge.js
- .gitignore
- .gitmodules
- build.sh
- CMakeLists.txt
- CONTRIBUTING.md
- LICENSE
- NOTICE
- README.md
# Installation Guide
1. Get the code
git clone https://github.com/swellweb/reame
Downloads the entire project code from GitHub to your computer.
cd reame
Moves into the project folder you just downloaded.
2. Official Install Script
Easy RecommendedPrerequisites
- APT (Debian/Ubuntu κ³μ΄) Built into Debian/Ubuntu-based Linux distributions.
- Homebrew A package manager for macOS/Linux.
sudo apt install build-essential cmake libboost-dev nlohmann-json3-dev libzstd-dev pkg-config
Installs directly from the APT package repository (Debian/Ubuntu-based).
brew install cmake boost nlohmann-json zstd pkg-config
Installs the pre-built package via Homebrew β no source build required.
After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.
Pulled directly from this repo's README.
3. CMake
MediumPrerequisites
sudo apt install build-essential cmake libboost-dev nlohmann-json3-dev libzstd-dev pkg-config
Installs directly from the APT package repository (Debian/Ubuntu-based).
brew install cmake boost nlohmann-json zstd pkg-config
Installs the pre-built package via Homebrew β no source build required.
Check that an executable was created inside the build folder, then run it directly (e.g. ./build/app_name).
Pulled directly from this repo's README.
// repository documentation
Was this content helpful?
(0 ratings)