tensorflow-shakespeare - GitLite

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #android #nodejs #windows #cli #vue #open-source

tensorflow-shakespeare

(★ 249)

Neural machine translation between the writings of Shakespeare and modern English using TensorFlow

File Explorer

Download Latest Version (.zip)

- - README.md
- shakespeare_norvig.txt
- - __init__.py
  - test_data.py
  - test_tokenizer.py
- - __init__.py
  - BUILD
  - data_utils.py
  - seq2seq_model.py
  - translate.py
- __init__.py
- get_data.py
- prepare_corpus.py
.gitignore
LICENSE
README.md
requirements.txt
run.sh

# Installation Guide

1. Get the code

git clone https://github.com/tokestermw/tensorflow-shakespeare

Downloads the entire project code from GitHub to your computer.

cd tensorflow-shakespeare

Moves into the project folder you just downloaded.

2. Official Install Script

Easy Recommended

Prerequisites

Python 3 Python is required to use pip.

pip install https://storage.googleapis.com/tensorflow/mac/tensorflow-0.5.0-py2-none-any.whl # for mac

Installs the package published on PyPI directly — no need to clone the source.

pip install https://storage.googleapis.com/tensorflow/linux/cpu/tensorflow-0.5.0-cp27-none-linux_x86_64.whl # for ubuntu

Installs the package published on PyPI directly — no need to clone the source.

✅ After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.

Pulled directly from this repo's README.

3. Python

Easy

Prerequisites

Git Needed to download the project code from GitHub.
Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.

pip install https://storage.googleapis.com/tensorflow/mac/tensorflow-0.5.0-py2-none-any.whl # for mac

Installs the package published on PyPI directly — no need to clone the source.

pip install https://storage.googleapis.com/tensorflow/linux/cpu/tensorflow-0.5.0-cp27-none-linux_x86_64.whl # for ubuntu

Installs the package published on PyPI directly — no need to clone the source.

python -m tensorshake.get_data

Runs the Python script (or module).

python -m tensorshake.prepare_corpus

Runs the Python script (or module).

✅ If it runs without errors and prints output in the terminal, it worked.

Pulled directly from this repo's README.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Shakespeare translations using TensorFlow

This is an example of using the new Google's [TensorFlow](https://github.com/tensorflow/tensorflow) library on
monolingual translation going from modern English to Shakespeare based on research from 
[Wei Xu](https://github.com/cocoxu/Shakespeare).

## Prepare

First download the TensorFlow library depending on your platform:

```
pip install https://storage.googleapis.com/tensorflow/mac/tensorflow-0.5.0-py2-none-any.whl # for mac
pip install https://storage.googleapis.com/tensorflow/linux/cpu/tensorflow-0.5.0-cp27-none-linux_x86_64.whl # for ubuntu
```

1. Grabs parallel data.
2. Gets train, dev split.
3. Builds vocabulary
4. Converts parallel data into ids

From the root directory:

```
python -m tensorshake.get_data
python -m tensorshake.prepare_corpus
```

Delete /cache to start anew.

## Train

Use the example BASH script to train the model. This saves the check points in the `--train_dir` directory.
If you run it again, the training process continues from the check point. To restart with fresh parameters,
simply delete/rename the check points.

```
./run.sh
```

## Results

[Benchmarks from original paper.](http://aclweb.org/anthology/C/C12/C12-1177.pdf) (Shakespeare -> Modern English)

Input | Output
 --- | ---
i will bite thee by the ear for that jest . | i ’ ll bite you by the ear for that joke .
what further woe conspires against mine age ? | what ’ s true despair conspires against my old age ?
how doth my lady ? |how is my lady ?
hast thou slain tybalt ? |have you killed tybalt ?
an i might live to see thee married once , i have my wish .| if i could live to see you married, i ’ ve my wish .
benvolio , who began this bloody fray ? | benvolio , who started this bloody fight itself ?
what is your will ? | what do you want ? 
call her forth to me . |bring her out to me .

*Cherrypicked examples from this repo* (Modern English -> Shakespeare)

| Input | Output 
----- | ---
but you’re not listening to me. | but you do not hear me .
Gregory, on my word, we will not be humiliated, like carrying coal. | regory , we 'll not carry coals .
but he got the promotion.  | he is the friend .
i can hit quickly, if i'm motivated. | i strike , i am moved .
Did you just give us the finger, sir? | have you leave the thumb , sir ?
You don’t know what you’re doing! | you do not what you know you .
have you killed Tybalt? | hast thou slain tybalt ?
Why, Romeo, are you crazy? | why , art thou mad , mad ?

## Pre-Trained Models

Here is a link for an example model: https://s3-us-west-2.amazonaws.com/foxtype-nlp/tensorshake/model_cache.zip

## Possible improvements

- word embeddings
- beam search
- language model reranking