resurrecting-the-dead-chinese

KO | EN

gitlite — search

#javascript #ai #llm #golang #android #machine-learning #linux #docker #java #windows #vue #mcp #openai #open-source

resurrecting-the-dead-chinese

(★ 17)

Text generation of the dead in Chinese

resurrecting-the-dead-chinese 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Resurrecting the Dead - Chinese

![](https://github.com/pyliaorachel/resurrecting-the-dead-chinese/blob/master/img/icon.png?raw=true)

Text generation system based on a mixed corpus of 《毛澤東語錄》(Quotations From Chairman Mao Tse-Tung) and《論語》(Confucian Analects).

[穿越時空的偉人：用PyTorch重現偉人們的神經網絡](https://pyliaorachel.github.io/blog/tech/nlp/2017/12/24/resurrecting-the-dead-chinese.html)

## Usage

###### Mix corpus

```bash
$ cd src/corpus
$ python3 mix.py <first-corpus> <second-corpus> --output <output-corpus-text-file>

# Or directly run
$ ./run.sh
```

###### Train

```bash
$ cd src
$ python3 -m train.train <corpus-text-file>

# For more options
$ python3 -m train.train -h

# Or directly run
$ ./train.sh
```

Outputs:

- `model.bin`: torch model
- `corpus.bin`: parsed corpus, mapping, & vocabulary

###### Text generation

```bash
$ cd src
$ python3 -m generate_text.gen <corpus-bin-file> <model-bin-file>

# For more options
$ python3 -m generate_text.gen -h

# Or directly run
$ ./gen.sh
```

## Structure

```
├── corpus                                          # Raw & parsed corpus
│   ├── corpus.txt                                      # Main corpus file for training
│   ├── luen_yu_clean.txt                               # Raw corpus with irrelevant words removed
│   ├── luen_yu_raw.txt                                 # Raw corpus
│   ├── luen_yu_sent.txt                                # Clean corpus seperated into sentences
│   ├── mao_clean.txt                                   # Raw corpus with irrelevant words removed
│   ├── mao_raw.txt                                     # Raw corpus
│   └── mao_sent.txt                                    # Clean corpus seperated into sentences
├── output                                          # Results
│   ├── log                                             # Log files
│   └── model                                           # Pretrained models
│       └── slxx-bsxx-edxx-hdxx-lrxx-drxx-epxx              # seq_length, batch_size, embedding_dim, hidden_dim, 
│                                                           # learning_rate, dropout, epochs
└── src                                             # Source codes
    ├── corpus                                          # Corpus processing
    │   ├── mix.py                                          # Mix two corpora
    │   └── run.sh                                          # Running the script
    ├── generate_text                                   # Text generation
    │   └── gen.py                                          # Text generation
    ├── train                                           # Model training
    │   ├── data.py                                         # Parse data
    │   ├── model.py                                        # Main LSTM model
    │   └── train.py                                        # Training
    ├── gen.sh                                          # Running text generation script
    └── train.sh                                        # Running training script
```

resurrecting-the-dead-chinese

resurrecting-the-dead-chinese 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

resurrecting-the-dead-chinese

resurrecting-the-dead-chinese 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README