GenieX
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
File Explorer
Download Latest Version (.zip)- build.md
- release.md
- SKILL.md
- SKILL.md
- settings.json
- action.yml
- action.yml
- action.yml
- action.yml
- action.yml
- action.yml
- ggml-htp-v1.cer
- README.md
- toolchain-android.Dockerfile
- toolchain-linux.Dockerfile
- bug_report.md
- feature_request.md
- pr_template.md
- release.js
- _build-android-aar.yml
- _build-cli.yml
- _build-docker.yml
- _build-python-sdist.yml
- _build-sdk.yml
- _build-toolchain-docker.yml
- _lint.yml
- _qdc-test.yml
- _test-rust.yml
- _unit-test.yml
- bench.yml
- docs-check.yml
- docs.yml
- pr-check.yml
- qcom-preflight-checks.yml
- release.yml
- stale-issues.yaml
- test.yml
- dependabot.yaml
- libomp.so
- CMakeLists.txt
- android_utils.cpp
- android_utils.h
- CMakeLists.txt
- geniex_sdk.cpp
- jni_cb.cpp
- jni_cb.h
- jniutils.cpp
- jniutils.h
- llm_bridge_jni.cpp
- model_manager_jni.cpp
- vlm_bridge_jni.cpp
- ChatMessage.kt
- ChipsetInfo.kt
- CreateInputBase.kt
- FileProgress.kt
- GenerationConfig.kt
- HubModel.kt
- HubSource.kt
- InputPluginBase.kt
- LlmApplyChatTemplateOutput.kt
- LlmCreateInput.kt
- LlmGenerateResult.kt
- LlmStreamResult.kt
- LLMTokenCallback.kt
- ModelConfig.kt
- ModelDetail.kt
- ModelPaths.kt
- ModelPullInput.kt
- ModelQuery.kt
- ModelType.kt
- PrecisionCandidate.kt
- ProfilingData.kt
- SamplerConfig.kt
- VlmCapabilities.kt
- VlmChatMessage.kt
- VlmContent.kt
- VlmCreateInput.kt
- DownloadProgressCallback.kt
- LLm.kt
- ModelManager.kt
- Vlm.kt
- GenieXSdk.kt
- LlmWrapper.kt
- ModelManagerWrapper.kt
- VlmWrapper.kt
- AndroidManifest.xml
- build.gradle.kts
- gradle-wrapper.jar
- gradle-wrapper.properties
- libs.versions.toml
- .gitignore
- build.gradle.kts
- gradle.properties
- gradlew
- gradlew.bat
- pom.xml
- README.md
- settings.gradle.kts
- BUILD.bazel
- common.go
- common_test.go
- crash_handler.c
- device.go
- go.mod
- helpers.go
- llm.go
- ml.go
- model_manager.go
- vlm.go
- __init__.py
- _api.py
- _lib.py
- _types.py
- __init__.py
- config.py
- output.py
- streamer.py
- __init__.py
- _progress.py
- _version.py
- auto.py
- cli.py
- model_manager.py
- modeling.py
- tokenizer.py
- test_cli_load_banner.py
- test_ensure_cached.py
- test_error_messages.py
- test_modeling_decode.py
- test_qairt_coerce.py
- test_quant_validation.py
- test_sdk_variant.py
- __init__.py
- conftest.py
- test_cli.py
- test_local_aihub_pull.py
- test_model_manager.py
- test_progress.py
- .gitignore
- _geniex_backend.py
- _sdk_fetch.py
- _shared_setup.py
- BUILD.bazel
- BUILD.md
- LICENSE
- MANIFEST.in
- pyproject.toml
- README.md
- setup.py
- .gitignore
- setup.py
- .gitignore
- setup.py
- sync_siblings.py
- BUILD.bazel
- console_other.go
- console_windows.go
- error.go
- error_test.go
- log.go
- process.go
- process_test.go
- repl.go
- sdk.go
- util_linux.go
- util_windows.go
- BUILD.bazel
- config.go
- help.go
- infer.go
- infer_test.go
- main.go
- model.go
- model_test.go
- run.go
- serve.go
- update.go
- version.go
- BUILD.bazel
- compute.go
- compute_test.go
- config.go
- config_test.go
- BUILD.bazel
- http.go
- http_test.go
- action.go
- buffer.go
- BUILD.bazel
- history.go
- package_test.go
- readline.go
- terminal.go
- terminal_linux.go
- terminal_windows.go
- BUILD.bazel
- package_test.go
- record.go
- stream_record.go
- BUILD.bazel
- progressbar.go
- spinner.go
- theme.go
- theme_test.go
- BUILD.bazel
- config.go
- manager.go
- package_test.go
- BUILD.bazel
- capture.go
- BUILD.bazel
- thinkfsm.go
- thinkfsm_test.go
- BUILD.bazel
- check.sh
- dedup_tar.bzl
- entrypoint.sh
- install.sh
- trixie.lock.json
- trixie.yaml
- BUILD.bazel
- geniex-cli-setup.iss
- geniex.ico
- iscc.bzl
- iss_manifest.bzl
- favicon-16x16.png
- favicon-32x32.png
- index.css
- index.html
- oauth2-redirect.html
- swagger-initializer.js
- swagger-ui-bundle.js
- swagger-ui-es-bundle-core.js
- swagger-ui-es-bundle.js
- swagger-ui-standalone-preset.js
- swagger-ui.css
- swagger-ui.js
- BUILD.bazel
- package_test.go
- swagger.go
- swagger.yaml
- BUILD.bazel
- chat.go
- chat_messages.go
- chat_response.go
- chat_stream.go
- chat_test.go
- chat_token.go
- completion.go
- completion_test.go
- logits.go
- model.go
- auth.go
- BUILD.bazel
- cors.go
- gil.go
- gil_test.go
- package_test.go
- BUILD.bazel
- keepalive.go
- keepalive_test.go
- service.go
- BUILD.bazel
- model.go
- BUILD.bazel
- common.go
- common_test.go
- toolcall.go
- toolcall_gemma4.go
- toolcall_gemma4_test.go
- toolcall_test.go
- BUILD.bazel
- route.go
- server.go
- server_test.go
- BUILD.bazel
- go.mod
- go.sum
- README.md
- README_zh.md
- platforms.mdx
- quickstart.mdx
- what-is-geniex.mdx
- supported.mdx
- faq.mdx
- troubleshooting.mdx
- api-reference.mdx
- install.mdx
- quickstart.mdx
- install.mdx
- local-server.mdx
- quickstart.mdx
- reference.mdx
- install.mdx
- api-reference.mdx
- install.mdx
- quickstart.mdx
- platforms.mdx
- quickstart.mdx
- what-is-geniex.mdx
- supported.mdx
- faq.mdx
- troubleshooting.mdx
- api-reference.mdx
- install.mdx
- quickstart.mdx
- install.mdx
- local-server.mdx
- quickstart.mdx
- reference.mdx
- install.mdx
- api-reference.mdx
- install.mdx
- quickstart.mdx
- audio-input.mdx
- speculative-decoding-mtp.mdx
- thumbs-down.svg
- thumbs-up.svg
- qdc-1.png
- qdc-2.png
- qdc-3.png
- curl-1.png
- curl-2.png
- curl-3.png
- curl-4.png
- curl-5.png
- updateStars.js
- GenieX-Logo-Icon-Black.png
- GenieX-Logo-Icon-White.png
- geniex_arch.png
- geniex_arch_v2.png
- page-feedback.mdx
- .gitignore
- docs.json
- README.md
- style.css
- windows.ipynb
- AI.md
- bench.md
- build.md
- README.md
- release.md
- run.md
- BUILD.bazel
- cgo_test.bzl
- multirun.bzl
- runfiles_symlink.bzl
- run_linux.sh
- sample_prompt_1024.txt
- sample_prompt_4096.txt
- sample_prompt_512.txt
- conftest.py
- requirements.txt
- test_bench.py
- utils.py
- run_windows.ps1
- _qdc.py
- bench-models.json
- run_qdc_jobs.py
- benchmark.c
- CMakeLists.txt
- README.md
- arm64-android-llvm-cpu.cmake
- arm64-android-llvm.cmake
- arm64-linux-gnu-cpu.cmake
- arm64-linux-gnu.cmake
- arm64-windows-llvm.cmake
- args.h
- base.h
- chrono.h
- color.h
- compile.h
- core.h
- format-inl.h
- format.h
- os.h
- ostream.h
- printf.h
- ranges.h
- std.h
- xchar.h
- date.h
- httplib.h
- json.hpp
- ILlm.h
- IVlm.h
- Plugin.h
- build_config.h
- geniex.h
- image_utils.h
- logging.h
- profile.h
- registry.h
- utils.h
- bench_pull.rs
- README.md
- chunk.rs
- mod.rs
- detect.rs
- dto.rs
- mod.rs
- remote_zip.rs
- selector.rs
- dockerhub.rs
- hf.rs
- localfs.rs
- mod.rs
- config.rs
- error.rs
- lib.rs
- logging.rs
- manifest.rs
- manifest_builder.rs
- mapping.rs
- pull.rs
- query.rs
- resume.rs
- store.rs
- transport.rs
- validation.rs
- go_manifest.json
- ai_hub_latest_version.rs
- ai_hub_live.rs
- ai_hub_pull.rs
- compat.rs
- executor.rs
- hf_live.rs
- local_aihub_pull.rs
- proxy_smoke.rs
- pull_resume.rs
- Cargo.toml
- chipset.rs
- hub_models.rs
- init.rs
- lib.rs
- logging.rs
- mapping.rs
- pull.rs
- query.rs
- store.rs
- types.rs
- Cargo.toml
- geniex_model.h
- geniex_model.ld
- .gitignore
- Cargo.lock
- Cargo.toml
- .gitattributes
- llama-hexagon-release-sessions.patch
- llama-opencl-adreno-cpy-constreg.patch
- htp_session.h
- llm.h
- params.h
- profiler.h
- threadpool.h
- vlm.h
- CMakeLists.txt
- htp_session.cpp
- llm.cpp
- params.cpp
- plugin.cpp
- profiler.cpp
- threadpool.cpp
- vlm.cpp
- CMakeLists.txt
- llm.h
- path_utils.h
- qnn_runtime_utils.h
- sampler_config_utils.h
- vlm.h
- CMakeLists.txt
- llm.cpp
- log_filter.cpp
- plugin.cpp
- vlm.cpp
- CMakeLists.txt
- CMakeLists.txt
- CMakeLists.txt
- device.cpp
- error.cpp
- llm.cpp
- logging_bridge.cpp
- ml.cpp
- registry.cpp
- utils.cpp
- version.cpp
- vlm.cpp
- .gitignore
- BUILD.bazel
- CMakeLists.txt
- CMakePresets.json
- README.md
- NOTICE.md
- quality_dog.jpg
- android_deploy.py
- conftest.py
- requirements.txt
- test_run_device.py
- run_pytest.sh
- run_pytest.ps1
- run_qdc_pytest.py
- _models.py
- _quality_data.py
- conftest.py
- models.json
- pytest.ini
- README.md
- ruff.toml
- test_api.py
- test_llama_cpp.py
- test_qairt.py
- geniex-qairt
- llama.cpp
- .bazelignore
- .bazelrc
- .bazelversion
- .clang-format
- .gitignore
- .gitmodules
- .mailmap
- BUILD.bazel
- CLAUDE.md
- CODE-OF-CONDUCT.md
- CODEOWNERS
- CONTRIBUTING.md
- GenieX-Logo-Hor-1-Black.png
- GenieX-Logo-Hor-1-White.png
- LICENSE
- MODULE.bazel
- MODULE.bazel.lock
- NOTICE
- README.md
- README_zh-CN.md
- repolint.json
- SECURITY.md
π Installation Guide
1. Get the code
git clone https://github.com/qualcomm/GenieX
Downloads the entire project code from GitHub to your computer.
cd GenieX
Moves into the project folder you just downloaded.
2. Official Install Script
Easy RecommendedPrerequisites
- Python 3 Python is required to use pip.
curl -fsSL https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-geniex/install.sh | sh
Downloads and runs the official install script in one line β this handles the full setup automatically.
pip install geniex
Installs the package published on PyPI directly β no need to clone the source.
After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.
Pulled directly from this repo's README.
3. CMake
MediumPrerequisites
cd bindings/android/app/src/main/cpp
This project's files live in a subfolder, so move into it first.
mkdir build && cd build
Creates a folder to hold the build output and moves into it.
cmake ..
Analyzes the source code and generates build configuration files (must be run inside the build folder).
make
Compiles the code based on the generated build configuration to produce an executable.
Check that an executable was created inside the build folder, then run it directly (e.g. ./build/app_name).
4. Maven (Java)
MediumPrerequisites
- Git Needed to download the project code from GitHub.
- JDK (Java) Required to build and run Java projects.
- Maven The build tool used for the mvn command.
cd bindings/android
This project's files live in a subfolder, so move into it first.
mvn clean install
Installs dependencies and builds the project using Maven.
A BUILD SUCCESS message means it worked. The output is created under target/.
5. Gradle (Java/Kotlin)
MediumPrerequisites
- Git Needed to download the project code from GitHub.
- JDK (Java) Required to build and run Java/Kotlin projects.
- Gradle If the repo includes gradlew (Gradle Wrapper), you don't need to install Gradle separately.
cd bindings/android/app
This project's files live in a subfolder, so move into it first.
./gradlew build
Builds the project using Gradle.
A BUILD SUCCESSFUL message means it worked. The output is created under build/.
6. Python
EasyPrerequisites
pip install geniex
Installs the package published on PyPI directly β no need to clone the source.
If it runs without errors and prints output in the terminal, it worked.
Pulled directly from this repo's README.
7. Go
MediumPrerequisites
cd bindings/go
This project's files live in a subfolder, so move into it first.
go build ./...
Compiles the Go program into an executable.
go run .
Runs the Go program directly without a separate build step.
If the build finishes without errors, it worked. If you used go run ., check the terminal output.
8. Rust
MediumPrerequisites
- Git Needed to download the project code from GitHub.
- Rust (rustup) Installing via rustup also installs cargo.
cd sdk/model-manager
This project's files live in a subfolder, so move into it first.
cargo build --release
Compiles the Rust project.
cargo run
Builds and then immediately runs the program.
If cargo build finishes without errors, it worked. The executable is created under target/.
// repository documentation
Was this content helpful?
(0 ratings)