Transformer-in-PyTorch

KO | EN

gitlite — search

#python #java #python3 #arduino #golang #machine-learning #rust #html #flask #javascript #seismology #nodejs

Transformer-in-PyTorch

★ 26 Open GitHub ↗

Transformer/Transformer-XL/R-Transformer examples and explanations

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Transformer-in-PyTorch
![GitHub](https://img.shields.io/github/license/cyk1337/Transformer-in-Pytorch)
- This repo contains the Transformer variants implementation in PyTorch (`Transformer` / `Transformer-XL` / `R-Transformer`). PR is welcome.
- If you are unfamilar with Transformer and its variants, refer to my blog:  [transformer explanation](http://ychai.uk/notes/2019/01/22/NLP/Attention-in-a-nutshell/#Transformer).

## Citation
For attribution in academic contexts, please cite this work as:
```
@misc{chai2019-transformer-in-pytorch,
  author = {Chai, Yekun},
  title = {Transformer-in-PyTorch},
  year = {2019},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/cyk1337/Transformer-in-PyTorch}}
}

@misc{chai2019attn-summary,
  author = {Chai, Yekun},
  title = {{Attention in a Nutshell}},
  year = {2019},
  howpublished = {\url{http://cyk1337.github.io/notes/2019/01/22/NLP/Attention-in-a-nutshell/}},
}
```

References:
- [The annotated Transformer](https://nlp.seas.harvard.edu/2018/04/03/attention.html)

Transformer-in-PyTorch

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README