gemma-jetson-demos

KO | EN

gitlite — search

#python #react #typescript #deep-learning #linux #nodejs #macos #windows #cli #kubernetes #awesome-list #security #openai #open-source

gemma-jetson-demos

(★ 81)

Gemma models running 100% local on an 8 GB Jetson Orin Nano: voice assistants with RAG, multi-agent NPCs, live EN-JA translation, and a Gemma 4 voice + vision agent that decides when to look through the webcam. The demos from the Gemma 2 launch at Google Tokyo.

gemma-jetson-demos 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Google Gemma on Jetson Orin Nano

This repository collects step-by-step demos of Google's Gemma family of models running locally on the NVIDIA Jetson Orin Nano. From the Tokyo Gemma Dev Day (Gemma 2) to the latest Gemma 4 VLA demos, all running on-device.

## YouTube Video
This video offers a detailed guide on setting up **Gemma 2** on the Jetson Orin Nano, covering installation, configuration, and execution of the demos. Watch it to get a better understanding of how to replicate the steps on your device:

[![Watch the video](https://img.youtube.com/vi/Kd7VJ-TKb8I/maxresdefault.jpg)](https://www.youtube.com/watch?v=Kd7VJ-TKb8I)

## Overview

- **Gemma4**: Voice + Vision Language Agent (VLA). Gemma decides on her own when to open the webcam based on your question.
- **Gemma3**: Modern implementation using Ollama with Gemma3n models.
- **Gemma2**: Original demos from the Tokyo Gemma Dev Day.

## Quick Start

### Gemma4 (VLA demo)

```bash
cd Gemma4
# build llama.cpp + download weights (see Gemma4/README.md for the full walkthrough)
python3 Gemma4_vla.py
```

### Gemma3n

```bash
cd Gemma3
./setup.sh
python assistant_ollama.py
```

### Gemma2 (Tokyo demo)

```bash
cd Gemma2
pip install -r requirements.txt
python assistant.py
```

## Project Structure

```
├── Gemma2/                 # Original LLaMA.cpp implementation (Tokyo Dev Day)
│   ├── assistant.py       # Voice assistant with RAG
│   ├── npcservers.py      # Multi-agent NPC conversation demo
│   ├── translate.py       # English to Japanese translation demo
│   ├── requirements.txt   # Python dependencies
│   └── assets/           # Audio files
│
├── Gemma3/                # Modern Ollama implementation
│   ├── assistant_ollama.py # Voice assistant
│   ├── demo_text.py       # Text-only demo
│   ├── test_ollama.py     # Connection test
│   ├── config.py          # Configuration file
│   ├── requirements.txt   # Python dependencies
│   ├── setup.sh          # Setup script
│   └── README.md         # Detailed documentation
│
├── Gemma4/                # VLA (Voice + Vision) demo with native llama.cpp
│   ├── Gemma4_vla.py     # The full demo script (STT + LLM + webcam + TTS)
│   └── README.md         # Step-by-step tutorial
│
└── README.md             # This file
```

## Use Cases

### Gemma4 (native llama.cpp + VLA)
- Fully local Voice + Vision agent on 8 GB Jetson Orin Nano
- Gemma decides when to look through the webcam (no keyword triggers)
- Parakeet STT + Kokoro TTS on-device
- Great starting point for agentic on-device AI

### Gemma3 (Ollama)
- Production deployments on Jetson Orin Nano
- Easy setup and maintenance
- Modern Gemma3n models
- Text and voice interfaces

### Gemma2 (LLaMA.cpp)
- Voice assistant with RAG
- Multi-agent NPC conversation simulation
- English to Japanese translation
- Research and development

## Requirements

### Gemma2
- LLaMA.cpp server running
- Gemma2 model files
- Piper TTS (optional)

### Gemma3
- Ollama installed
- Internet connection (for model download)

## Documentation

- **[Gemma4 Tutorial](Gemma4/README.md)** - Voice + Vision Language Agent walkthrough
- **[Gemma3 Documentation](Gemma3/README.md)** - Modern implementation details
- **[Gemma2 Documentation](Gemma2/README.md)** - Original implementation details

## License

This project is open source and available under the MIT License.

## Acknowledgments

- Google for the Gemma models
- Ollama team for the excellent framework

---

## 🛠️ Installation – Ollama on NVIDIA Systems

To run Gemma 3 locally, you'll need to install **Ollama**.

### On Jetson or Linux

Run the following command in your terminal:

```bash
curl -fsSL https://ollama.com/install.sh | sh
```

---

## 🚀 Running Gemma 3 with Ollama

Pull and run the desired model size (4B recommended for Jetson):

```bash
ollama pull gemma3:4b
ollama run gemma3:4b
```

For larger variants on AGX Orin:

```bash
ollama pull gemma3:12b
ollama run gemma3:12b

ollama pull gemma3:27b-it-qat
ollama run gemma3:27b-it-qat
```

Run prompts directly:

```bash
ollama run gemma3:12b -p "Summarize a research paper in plain English."
```

For multimodal (image + text) tasks:

```bash
ollama run gemma3:4b "Describe this image" < ./image.png
```

---

## Directory Structure

The project is organized as follows:

```
GEMMALLAMA/
│
├── assets/
│   ├── bip.wav      # Sound file to indicate the start of a recording
│   └── bip2.wav     # Sound file to indicate the end of a recording
│
├── npcs/
│   └── conversation_log.html  # Directory where NPC conversations will be stored in HTML format
│
├── assistant.py     # Script for the Home Assistant demo, using Whisper, FAISS, and Piper
├── npcservers.py    # Script for the multi-agent system demo, where two Gemma instances interact
└── translate.py     # Script for the translation assistant demo, using Whisper and Coqui TTS
```

- **assets/**: Contains audio files (`bip.wav`, `bip2.wav`) used to indicate when recording starts and ends.
- **npcs/**: This folder stores conversation logs in HTML format. For example, when two NPCs (Gemma and Gemmo) converse, their dialogue is saved here.
- **assistant.py**: Implements a voice-activated assistant using Whisper for transcription, FAISS for retrieval, and Piper for text-to-speech.
- **npcservers.py**: Simulates conversations between two LLaMA-based agents (Gemma and Gemmo) with different personalities.
- **translate.py**: Translates speech from English to Japanese using Whisper and Coqui TTS for speech synthesis.

gemma-jetson-demos

gemma-jetson-demos 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

gemma-jetson-demos

gemma-jetson-demos 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README