zundamon-speech-webui

KO | EN

gitlite — search

#hacktoberfest #llm #go #golang #rust #linux #docker #nodejs #java #windows #awesome #cli #kubernetes #security

zundamon-speech-webui

(★ 84)

No description available.

zundamon-speech-webui Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Zundamon Speech WebUI

This repository provides an official trial version of the **Zundamon Speech WebUI**. It allows users to try **Zundamon's TTS audio generation** and explore its capabilities.

Official website: https://zunko.jp/

## Reference Movie

For users who may face difficulties during installation, the following tutorial videos provide step-by-step guidance:

- [Installation Guide Video 1](https://www.youtube.com/watch?v=KZaFLIta2WU)
- [Installation Guide Video 2](https://www.youtube.com/watch?v=cWBAWCUg9s4)
- [Installation Guide Video 3](https://www.youtube.com/watch?v=nMXaVyoxGz0)

By following these videos, users can avoid common issues related to folder structure and setup.

## Overview

This project is based on [GPT-SoVITS](https://github.com/RVC-Boss/GPT-SoVITS) and has been adapted and fine-tuned for Zundamon's voice synthesis. The WebUI for inference is built using Streamlit, providing a user-friendly interface for generating Zundamon's speech audio files.

## Features

1. **User-Friendly Web Interface**: Easily upload reference audio and text, input your target text, and generate Zundamon's voice in your desired language.
2. **Custom Models**: Fine-tuned models specifically for Zundamon are included to provide high-quality voice synthesis.
3. **Reference Files**: Sample reference audio and text for Zundamon are provided in the `reference` folder.
4. **Download Support**: Generated audio files can be downloaded directly from the interface.
5. **Multilingual Support**: Choose from multiple languages for both reference and target text.

## Prerequisites

Before starting, ensure you have the required dependencies installed:

```bash
pip install -r requirements.txt
```

After installing the dependencies, please install PyTorch manually from the official website.

The following PyTorch version has been tested and verified to work successfully:

- **PyTorch**: `2.1.2`
- **CUDA**: `12.1`
- **Python**: `3.9`

You can install it using the [following command](https://pytorch.org/get-started/previous-versions/#linux-and-windows-19):

```bash
pip install torch==2.1.2 torchvision==0.16.2 torchaudio==2.1.2 --index-url https://download.pytorch.org/whl/cu121
```

For other installation options, please visit the official [PyTorch website](https://pytorch.org/get-started/previous-versions/).

## Setup Instructions

### **Step 1: Clone the Repository (with Submodules)**

To ensure all required submodules are initialized properly, use the following command:

```bash
git clone --recursive https://github.com/zunzun999/zundamon-speech-webui.git
cd zundamon-speech-webui
```

If you have already cloned the repository without the `--recursive` flag, run:

```bash
git submodule update --init --recursive
```

### Step 2: Download Pretrained Models

1. **Download GPT-SoVITS Pretrained Models**: Place the pretrained models in the `GPT-SoVITS/GPT_SoVITS/pretrained_models` folder:
    - Use the following commands to download and set up the models:
        
        ```bash
        git lfs install
        ```

```bash
        git clone https://huggingface.co/lj1995/GPT-SoVITS
        ```
2. **Download G2PW Models**: Download and unzip the G2PW models from [G2PWModel_1.1.zip](https://paddlespeech.bj.bcebos.com/Parakeet/released_models/g2p/G2PWModel_1.1.zip), rename the folder to `G2PWModel`, and place it in `GPT-SoVITS/GPT_SoVITS/text`.
3. **Download Zundamon Fine-Tuned Model**:
Download the [fine-tuned models](https://huggingface.co/zunzunpj/zundamon_GPT-SoVITS/tree/main) for Zundamon and place them in the `zundamon-speech-webui/GPT-SoVITS` folder:
    - Fine-tuned models include `GPT_weights_v2` and `SoVITS_weights_v2`.
    - Use the following commands to download and set up the models:
        
        ```bash
        git clone https://huggingface.co/zunzunpj/zundamon_GPT-SoVITS
        ```

### Additional Requirements for Windows Installation

1. **Download and Install FFmpeg**
    - Download and place [ffmpeg.exe](https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/ffmpeg.exe) and [ffprobe.exe](https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/ffprobe.exe).
    - Place them in the root directory of `zundamon-speech-webui/GPT-SoVITS`.
2. **Install Visual Studio Build Tools**
    - Visit the [Visual Studio Download Page](https://visualstudio.microsoft.com/visual-cpp-build-tools/).
    - Download and install "Visual Studio Build Tools".
    - During installation, select "Desktop development with C++".
3. **Install CMake**
    - Visit the [CMake Official Site](https://cmake.org/download/).
    - Download and install the Windows version of CMake.
    - During installation, choose "Add CMake to the system PATH".

### Troubleshooting

If you encounter an error like:

```
An error occurred during inference:
Resource averaged_perceptron_tagger_eng not found.
```

Try running the following commands in your project environment:

```python
import nltk
nltk.download('averaged_perceptron_tagger')
nltk.download('averaged_perceptron_tagger_eng')
```

This will ensure the necessary NLTK resources are downloaded.

## How to Use the WebUI

1. Navigate to the project directory:
    
    ```bash
    cd zundamon-speech-webui
    ```
    
2. Run the WebUI using Streamlit:
    
    ```bash
    python zundamon_speech_run.py
    ```
    
3. Open the WebUI in your browser (URL will be displayed in the terminal).
![Zundamon WebUI Example](https://raw.githubusercontent.com/zunzun999/zundamon-speech-webui/main/imgs/webui.PNG)

## How to Generate Zundamon's Voice Audio

1. **Upload Reference Files**
    - **Step 1: Reference Audio File** Upload a sample audio file for Zundamon's voice (`.wav`).
    - **Step 2: Reference Text** Provide or upload a text file that corresponds to the reference audio file.
2. **Input Target Details**
    - **Step 3: Target Text** Enter the text you want to synthesize in Zundamon's voice.
    - **Step 4: Language Selection** Select the language for both reference and target text.
3. **Generate Audio**
    
    Click the **Generate Speech** button. After processing, the synthesized audio will be displayed with options to preview and download.

## Sample Reference Files

A sample reference audio file and corresponding text for Zundamon are included in the `reference` folder. Feel free to use them to test the WebUI.

For additional Zundamon voice resources, visit the official download page:

https://zunko.jp/multimodal_dev/login.php

## License Information

This software includes the following open-source software:

- [GPT-SoVITS](https://github.com/RVC-Boss/GPT-SoVITS) (MIT License)
- [GPT-SoVITS Pretrained Models](https://huggingface.co/lj1995/GPT-SoVITS) (MIT License)
- [G2PW Model](https://github.com/GitYCC/g2pW) (Apache 2.0 License)
- [UVR5 (Voice Cleaning)](https://huggingface.co/lj1995/VoiceConversionWebUI/tree/main/uvr5_weights) (MIT License)
- [Faster Whisper Large V3](https://huggingface.co/Systran/faster-whisper-large-v3) (MIT License)

These are provided under their respective license terms.

The license for the Zundamon Voice model is as follows:
https://zunko.jp/con_ongen_kiyaku.html

zundamon-speech-webui

zundamon-speech-webui Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

zundamon-speech-webui

zundamon-speech-webui Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README