voice-text-reader

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

voice-text-reader

(★ 51)

Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)

voice-text-reader Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# voice-text-reader
Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)

# Description
This script reads any text file using voice cloning. It automatically splits the text into smaller chunks, creates wav files and plays them. If you stop the script and start it again with the same file it will start close to the same position where you have stopped it. The positions are stored in files ending on _pos.txt. You also can manually define a start position.

Additionally you can use a LLM via API to translate the text into a different language and read that translation instead. This all works in realtime, with a small lead time at the beginning on a 1050 GTX with just 4GB VRAM (It uses xtts-v2, and 4GB vram only works if you have closed anything else, so I recommend at least 6GB VRAM to be on the safe side)

For the translation I'm using https://huggingface.co/mradermacher/Llama-3.2-3B-Instruct-uncensored-GGUF as it is a fast and suitable model giving up to 20 Tokens/s on a AMD 7950x cpu using llama.cpp. To make the translation work, I use the Dolphin prompt. Some models refuse to translate or return a wrong form. In that case the translation is repeated until the output contains text between the tags \<translation> and \</translation>.
You can also use chatgpt or any other service as long you provide the correct address and api key.

# Installation

Make sure all required python packages are installed:
```
pip install requirements.txt
```

For real time usage you will need a NVIDIA GPU, at least 1050 GTX or better. So you must install cuda on your device.

# Usage
Make sure you have prepared your desired voice talking on a .wav or .mp3 file. If you do not provide a speaker file, a file of a sine wave is used for voice cloning which will often cause bad quality speech.

Reading an english text:
```
python voice-text-reader.py -t sample.txt -l en -sp desired_voice.mp3
```
Reading a german text starting at position of 1000 chars:
```
python voice-text-reader.py -t sample.txt -l de -sp desired_voice.mp3 -p 1000
```

Reading a text of any language translated to spanish:
```
python voice-text-reader.py -t sample.txt -l es -sp desired_voice.mp3 -trans spanish -trans_path http://localhost:1234 -trans_api API_KEY_HERE
```

```
All options:
  -h, --help            show this help message and exit
  -t TEXT, --text TEXT  The path of the text file to be read.
  -p POSITION, --position POSITION
                        The position in characters at which the reading of the file should start. Defaults to 0. If you do not set a value besides 0 the reading will continue
                        at the position where you have stopped the script.
  -l LANGUAGE, --language LANGUAGE
                        The language of the text. (en,de,fr,es....)
  -sp SPEAKER_FILE, --speaker_file SPEAKER_FILE
                        The path of the speaker file for voice cloning.
  -d DEVICE, --device DEVICE
                        The device for speak generation. cpu / cuda (default: cuda)
  -trans TRANSLATION, --translation TRANSLATION
                        The language the text is translated before it is converted into speech.(default: none) Should match language. But use the full english word like german
                        or italian not de or it as this is part of a prompt send to your LLM.
  -trans_path TRANSLATION_PATH, --translation_path TRANSLATION_PATH
                        The API path to the LLM model for translation. (e.g. http://localhost:1234)
  -trans_api TRANSLATION_API_KEY, --translation_api_key TRANSLATION_API_KEY
                        The API key for the LLM model used for translation.
```

voice-text-reader

voice-text-reader Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

voice-text-reader

voice-text-reader Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README