spec_augment

KO | EN

gitlite — search

#javascript #react #ai #llm #golang #android #rust #deep-learning #java #windows #kubernetes #mcp #ios #openai

(★ 501)

🔦 A Pytorch implementation of GoogleBrain's SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition

파일 탐색기

최종 버전 다운로드 (.zip)

- - nb_SparseImageWarp.cpython-37.pyc
- nb_SparseImageWarp.py
- combined.png
- freqmask.png
- timemask.png
- timewarp.png
.gitignore
install.sh
LICENSE
notebook2script.py
party-crowd.wav
README.md
SparseImageWarp.ipynb
SpecAugment.ipynb

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# SpecAugment with Pytorch
## A Pytorch Implementation of GoogleBrain's SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
[Medium Article](https://towardsdatascience.com/sota-data-augmentation-with-google-brains-specaugment-and-pytorch-d3d1a3ce291e)

[SpecAugment](https://ai.googleblog.com/2019/04/specaugment-new-data-augmentation.html) is a state of the art data augmentation approach for speech recognition.

The paper's authors did not publish code that I could find and their implementation was in TensorFlow. We implemented all three SpecAugment transforms using Pytorch, torchaudio, and [fastai](https://fast.ai) / [fastai-audio](https://github.com/zcaceres/fastai-audio).

## To use:
1. Run `install.sh` (I recommend using a unique `conda` env for the project)

After the install script runs, you should have a `torchaudio` folder in your project folder.

2. Check out SpecAugment.ipynb (a Jupyter notebook) for the functions.

### Augmentations
Time Warp
![time warp aug](https://raw.githubusercontent.com/zcaceres/spec_augment/master/img/timewarp.png)

Time Mask
![time mask aug](https://raw.githubusercontent.com/zcaceres/spec_augment/master/img/timemask.png)

Frequency Mask
![freq mask aug](https://raw.githubusercontent.com/zcaceres/spec_augment/master/img/freqmask.png)

Combined:
![combined augs](https://raw.githubusercontent.com/zcaceres/spec_augment/master/img/combined.png)

### Note on Time Warp
The Time Warp augmentation relies on Tensorflow-specific functionality not supported in Pytorch. We implemented supporting functions for this augmentation in `SparseImageWarp.ipynb`. You do not need to look at this notebook to use the augmentations. But the Time Warp augmentation depends on code exposed in the `SparseImageWarp` notebook.

Let's be friends!
- [@zachcaceres](https://twitter.com/zachcaceres)
- [zach.dev](https://zach.dev)

spec_augment

파일 탐색기

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

spec_augment

파일 탐색기

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README