gpt2-imdb

KO | EN

gitlite — search

#python #react #typescript #golang #machine-learning #docker #macos #awesome #cli #kubernetes #awesome-list #security #pytorch #open-source

(★ 9)

No description available.

gpt2-imdb 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# gpt2-imdb <a href="https://web.spell.ml/workspace_create?workspaceName=gpt2-imdb&githubUrl=https%3A%2F%2Fgithub.com%2Fspellml%2Fgpt2-imdb&pip=transformers,tokenizers,nlp"><img src=https://spell.ml/badge.svg height=20px/></a>

`pytorch` scripts training GPT2 (trained from scratch) on the IMDB movie reviews dataset. The model and data are via `hugginface` `transformers`.

Even with the standard settings GPT2 is such a large model that it's hard to fit many items per batch onto a single video card! That makes this training script useful for benchmarking a large-scale attention NLP model training job.

To run on Spell:

```bash
spell run --machine-type v100 \
  --github-url https://github.com/spellml/gpt2-imdb.git \
  --pip transformers --pip nlp --pip tokenizers \
  --tensorboard-dir /spell/tensorboards/model_1/ \
  "python models/model_1.py"
```
```bash
spell run --machine-type v100x4 \
  --github-url https://github.com/spellml/gpt2-imdb.git \
  --pip transformers --pip nlp --pip tokenizers \
  --tensorboard-dir /spell/tensorboards/model_2/ \
  "python models/model_2.py"
```
```bash
spell run --machine-type v100x8 \
  --github-url https://github.com/spellml/gpt2-imdb.git \
  --pip transformers --pip nlp --pip tokenizers \
  --tensorboard-dir /spell/tensorboards/model_2/ \
  "python models/model_2.py"
```
```bash
spell run --machine-type v100x4 \
  --github-url https://github.com/spellml/gpt2-imdb.git \
  --pip transformers --pip nlp --pip tokenizers \
  --tensorboard-dir /spell/tensorboards/model_3/ \
  "python models/model_3.py"
```
```bash
spell run --machine-type v100x8 \
  --github-url https://github.com/spellml/gpt2-imdb.git \
  --pip transformers --pip nlp --pip tokenizers \
  --tensorboard-dir /spell/tensorboards/model_3/ \
  "python models/model_3.py"
```

gpt2-imdb

gpt2-imdb 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

gpt2-imdb

gpt2-imdb 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README