android-screen-translator

KO | EN

gitlite — search

#hacktoberfest #android #rust #docker #macos #nodejs #awesome #kubernetes #vue #security #ios #mcp #openai #open-source

android-screen-translator

(★ 10)

Screen Translate - Android screen translation app with OCR and multiple translation engines

android-screen-translator 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<h1 align="center">Screen Translate</h1>

Point. Tap. Understand. 
 Instantly translate any text on your Android screen — right where it appears.

---

## The Problem

You're reading a webpage in Japanese. Or watching a Korean drama without subtitles. Or trying to use a Chinese app. Every time, you have to:

1. Long-press the text (if you even can)
2. Copy it
3. Switch to a translator app
4. Paste it
5. Read the translation
6. Switch back

**What if you could just... point at it?**

---

## How It Works

Screen Translate floats on top of whatever you're doing. Just drag the pointer to any text, and the translation appears instantly — like magic.

<table>
 <tr>
 <td align="center" width="50%">
 Word Mode 
 Tap any word for instant translation 
 <img src=".images/word_original_rounded.gif" width="280" alt="Word Mode"/>
 </td>
 <td align="center" width="50%">
 Sentence Mode 
 Auto-detects and translates full sentences 
 <img src=".images/sentence_original_rounded.gif" width="280" alt="Sentence Mode"/>
 </td>
 </tr>
 <tr>
 <td align="center">
 Paragraph Mode 
 Translates entire blocks of text at once 
 <img src=".images/paragraph_original_rounded.gif" width="280" alt="Paragraph Mode"/>
 </td>
 <td align="center">
 Selection Mode 
 Draw a box around exactly what you need 
 <img src=".images/select_original_rounded.gif" width="280" alt="Selection Mode"/>
 </td>
 </tr>
</table>

---

## Works Everywhere

News apps, social media, games, manga, webtoons — if there's text on screen, it can be translated.

---

## Pick Your Translation Engine

Not all translation engines are created equal. Screen Translate lets you switch between **five engines** to find the best one for your language pair:

<table>
 <tr>
 <td align="center" width="20%">
 <img src="https://img.shields.io/badge/Google-4285F4?style=for-the-badge&logo=googletranslate&logoColor=white" alt="Google Translate"/> 
 Google Translate 
 The all-rounder. Fast, free, and built in — no key needed.
 </td>
 <td align="center" width="20%">
 <img src="https://img.shields.io/badge/DeepL-0F2B46?style=for-the-badge&logo=deepl&logoColor=white" alt="DeepL"/> 
 DeepL 
 Natural, human-sounding translations. Best for European languages.
 </td>
 <td align="center" width="20%">
 <img src="https://img.shields.io/badge/OpenAI-412991?style=for-the-badge&logo=openai&logoColor=white" alt="OpenAI"/> 
 OpenAI 
 LLM translation that keeps context, tone, and idiom.
 </td>
 <td align="center" width="20%">
 <img src="https://img.shields.io/badge/Gemini-8E75B2?style=for-the-badge&logo=googlegemini&logoColor=white" alt="Gemini"/> 
 Gemini 
 Google's LLM. Fast, with a generous free tier.
 </td>
 <td align="center" width="20%">
 <img src="https://img.shields.io/badge/Claude-D97757?style=for-the-badge&logo=claude&logoColor=white" alt="Claude"/> 
 Claude 
 Anthropic's LLM. Strong at nuance and longer passages.
 </td>
 </tr>
</table>

> Google works out of the box. **DeepL, OpenAI, Gemini and Claude run on your own API key** — enter it under *Settings → API Key*. For the three LLM engines you can also choose which model to use.

> **A note on the screenshots:** some still show the older engine line-up, which included **Azure Translator** and **Papago**. Those two ran on API keys the app handed out to paid installs — when the paid features were removed, the keys went away and those engines went with them. DeepL and OpenAI stayed on by switching to keys you supply yourself.

---

## 130+ Languages

From Arabic to Zulu, from English to Japanese — translate between **130+ languages** with automatic source language detection. No need to manually set what language you're reading.

---

## Why I Built This

I live between languages every day, and existing solutions all required too many steps. I wanted something that just **works** — point at text, get the meaning. No context switching, no clipboard juggling.

Over time, it grew into a full-featured translation tool with multiple engines and smart text recognition. And now **over 1 million people** use it.

---

## Under the Hood

> *For the curious developers who want to peek inside.*

### How the magic happens

1. **Screen Capture** — Android's `MediaProjection` API continuously captures what's on your screen
2. **Text Recognition** — Google ML Kit runs **on-device OCR** to find and extract text from the captured frames
3. **Smart Grouping** — A custom algorithm clusters detected text into words, lines, sentences, or paragraphs based on position, spacing, and font size
4. **Translation** — The recognized text is sent to your chosen translation engine via REST APIs
5. **Overlay Rendering** — Results are displayed in a floating Compose UI overlay on top of your current app

All of this happens in **under a second**.

### Tech highlights

| | |
|---|---|
| **Kotlin + Jetpack Compose** | Modern Android UI with reactive state management |
| **Adaptive, edge-to-edge UI** | Scales cleanly from phones to tablets and foldables |
| **Clean Architecture + MVVM** | Separation of concerns with ViewModels and Repositories |
| **Hilt** | Dependency injection for clean, testable code |
| **ML Kit** | On-device OCR for English, Chinese, Japanese, Korean, and Devanagari |
| **Multi-engine translation** | Google, DeepL, OpenAI, Gemini, and Claude behind one interface |
| **Coroutines + StateFlow** | Smooth async operations without callback hell |
| **Firebase** | Analytics, Crashlytics, and Remote Config |
| **Firebase App Check** | Play Integrity attestation for backend requests |
| **AdMob** | A rewarded-ad gate — how the app stays free |
| **Encrypted key storage** | AES-GCM + Android Keystore for user-supplied API keys |
| **MediaProjection** | Real-time screen capture with optimized frame streaming |

### Project structure

```
app/src/main/java/com/galaxy/airviewdictionary/
├── core/                  # OverlayService — the heart of the app
├── data/
│   ├── local/
│   │   ├── vision/        # OCR & text grouping algorithms
│   │   ├── capture/       # Screen capture via MediaProjection
│   │   ├── tts/           # Text-to-Speech
│   │   ├── secure/        # Encrypted storage for user API keys
│   │   ├── ads/           # Rewarded-ad state
│   │   └── preference/    # User settings
│   └── remote/
│       ├── translation/   # Google, DeepL, OpenAI, Gemini, Claude
│       ├── firebase/      # Analytics & Remote Config
│       └── geolocale/     # Region lookup
├── ui/
│   ├── screen/
│   │   ├── overlay/       # Floating translation UI
│   │   ├── main/          # Settings screens
│   │   ├── ads/           # Rewarded-ad gate
│   │   ├── reply/         # Reply translation window
│   │   └── onboarding/    # First-time setup
│   └── common/            # Shared components
├── di/                    # Hilt dependency injection
└── extensions/            # Kotlin extension functions
```

---

## Building from Source

### What you need

- **Android Studio** (2025.3 or later — the project builds with AGP 9)
- **JDK 17**
- **Android SDK 36**

### Steps

1. **Clone the repo**
   ```bash
   git clone https://github.com/AidanPark/android-screen-translator.git
   cd android-screen-translator
   ```

2. **Set up signing** — Edit `gradle.properties`:
   ```properties
   KEYSTORE_FILE=your-keystore.jks
   KEY_ALIAS=your-key-alias
   KEY_PASSWORD=your-key-password
   ```

3. **Add Firebase config** — Place your own `google-services.json` in the `app/` directory

4. **Build & Run**
   ```bash
   ./gradlew assembleDebug
   ```

> **Note:** You'll need your own Firebase project to run the full app. Google translation and the on-device OCR need no API key at all. DeepL, OpenAI, Gemini and Claude are optional — they use keys you enter inside the app at runtime (*Settings → API Key*), not build-time config.

---

## Permissions Explained

| Permission | What it does |
|-----------|-------------|
| **Display over other apps** | Shows the floating translation overlay |
| **Screen capture** | Reads text from your screen using OCR |
| **Internet** | Connects to translation APIs |
| **Vibration** | Gives haptic feedback when text is detected |
| **Notifications** | Required for the foreground service indicator |

---

## License

This project is provided for **educational and reference purposes**. See [LICENSE](LICENSE) for details.

---

<a href="https://play.google.com/store/apps/details?id=com.galaxy.airviewdictionary">
 <img src="https://play.google.com/intl/en_us/badges/static/images/badges/en_badge_web_generic.png" width="220" alt="Get it on Google Play"/>
 </a>
 
 Made with caffeine and curiosity.

android-screen-translator

android-screen-translator 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

android-screen-translator

android-screen-translator 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README