FastSpeech

KO | EN

gitlite — search

#typescript #ai-agents #ai #dsh-plugin #deepseek-harness #open-source #claude-code #codex #cli #developer-tools #react #windows

★ 54 Open GitHub ↗

Implementation of "FastSpeech: Fast, Robust and Controllable Text to Speech"

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# FastSpeech
Implementation of ["FastSpeech: Fast, Robust and Controllable Text to Speech"](https://arxiv.org/abs/1905.09263)  
  
## Training  
0. Set `data_path` in `hparams.py` as the LJSpeech folder  
1. Set `teacher_dir` in `hparams.py` as the data directory where the alignments and melspectrogram targets are saved  
2. Put checkpoint of the pre-trained transformer-tts (weights of the embedding/encoder layers are used)  
3. `python train.py`

## Training curves (orange: character  / blue: phoneme)  
##### The size of the train dataset is different because transformer-tts trained with phoneme shows more diagonal attention  
##### train:val:test=8:1:1, total => character:1126 / phoneme:3412  
<img src="figures/duration_loss.JPG" height="200">  
<img src="figures/train_loss.JPG" height="200">  
<img src="figures/val_loss.JPG" height="200">

## Training plots (orange: batch_size:64 / blue: batch_size:32)  
<img src="figures/melspec.JPG" height="300">

## Audio Samples    
You can hear the audio samples [here](https://leeyoonhyung.github.io/FastSpeech/)

FastSpeech

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README