STGAN - GitLite

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #go #android #deep-learning #docker #java #kubernetes #awesome-list #pytorch #mcp

STGAN

(★ 441)

STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editing

파일 탐색기

최종 버전 다운로드 (.zip)

- - 128.ckpt.data-00000-of-00001
  - 128.ckpt.index
  - 128.ckpt.meta
- - __init__.py
  - basic.py
  - dtype.py
  - encode.py
  - transform.py
- - __init__.py
  - checkpoint.py
  - collection.py
  - parallel.py
  - tfrecord.py
  - utils.py
- models.py
- README.md
- test.py
- train.py
- __init__.py
- basic.py
- dtype.py
- encode.py
- transform.py
- STGAN-suppl.pdf
- STGAN.pdf
- arch.jpg
- face_comp.jpg
- face_HD.jpg
- face_suppl_HD.jpg
- face_suppl_multiple.jpg
- face_suppl_single.jpg
- season.jpg
- season_suppl.jpg
- __init__.py
- timer.py
- utils.py
- - __init__.py
  - layers.py
- __init__.py
- checkpoint.py
- utils.py
- variable.py
.gitignore
data.py
LICENSE
models.py
README.md
results.md
show_images.py
test.py
train.py

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# STGAN (CVPR 2019)

**Tensorflow** implementation of [**STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editing**](https://arxiv.org/abs/1904.09709)

<p align="center"> <img src="./pic/arch.jpg" width="95%"><br><center>Overall architecture of our STGAN. Taking the image above as an example, in the difference attribute vector <a href="http://latex.codecogs.com/gif.latex?\mathbf{att}_\mathit{diff}"><img src="http://latex.codecogs.com/gif.latex?\mathbf{att}_\mathit{diff}" alt="$\mathbf{att}_\mathit{diff}$"></a>, <a href="http://latex.codecogs.com/gif.latex?Young"><img src="http://latex.codecogs.com/gif.latex?Young" alt="$Young$"></a> is set to 1, <a href="http://latex.codecogs.com/gif.latex?Mouth\%20Open"><img src="http://latex.codecogs.com/gif.latex?Mouth\%20Open" alt="$Mouth\ Open$"></a> is set to -1, and others are set to zeros. The outputs of <a href="http://latex.codecogs.com/gif.latex?\mathit{D_{att}}"><img src="http://latex.codecogs.com/gif.latex?\mathit{D_{att}}" alt="$\mathit{D_{att}}$"></a> and <a href="http://latex.codecogs.com/gif.latex?\mathit{D_{adv}}"><img src="http://latex.codecogs.com/gif.latex?\mathit{D_{adv}}" alt="$\mathit{D_{adv}}$"></a> are the scalar <a href="http://latex.codecogs.com/gif.latex?\mathit{D_{adv}}(\mathit{G}(\mathbf{x},\mathbf{att}_\mathit{diff}))"><img src="http://latex.codecogs.com/gif.latex?\mathit{D_{adv}}(\mathit{G}(\mathbf{x},\mathbf{att}_\mathit{diff}))" alt="$\mathit{D_{adv}}(\mathit{G}(\mathbf{x}, \mathbf{att}_\mathit{diff}))$"></a> and the vector <a href="http://latex.codecogs.com/gif.latex?\mathit{D_{att}}(\mathit{G}(\mathbf{x},\mathbf{att}_\mathit{diff}))"><img src="http://latex.codecogs.com/gif.latex?\mathit{D_{att}}(\mathit{G}(\mathbf{x},\mathbf{att}_\mathit{diff}))" alt="$\mathit{D_{att}}(\mathit{G}(\mathbf{x}, \mathbf{att}_\mathit{diff}))$"></a>, respectively</center></p>

## Exemplar Results

- See [results.md](./results.md) for more results

- Facial attribute editing results

<p align="center"><img src="./pic/face_comp.jpg" width="95%"><br><center>Facial attribute editing results on the CelebA dataset. The rows from top to down are results of <a href="https://github.com/Guim3/IcGAN" target="_blank" title="IcGAN@Guim3">IcGAN</a>, <a href="https://github.com/facebookresearch/FaderNetworks" target="_blank" title="FaderNet@facebookresearch">FaderNet</a>, <a href="https://github.com/LynnHo/AttGAN-Tensorflow" target="_blank" title="AttGAN@LynnHo">AttGAN</a>, <a href="https://github.com/yunjey/stargan" target="_blank" title="StarGAN@yunjey">StarGAN</a> and STGAN.</center></p>
    <p align="center"><img src="./pic/face_HD.jpg" width="95%"><br><center>High resolution (<a href="http://latex.codecogs.com/gif.latex?384\times384"><img src="http://latex.codecogs.com/gif.latex?384\times384" alt="$384\times384$"></a>) results of STGAN for facial attribute editing.</center></p>
    
- Image translation results

<p align="center"><img src="./pic/season.jpg" width="50%"><br><center>Results of season translation, the top two rows are <a href="http://latex.codecogs.com/gif.latex?summer%20\rightarrow%20winter"><img src="http://latex.codecogs.com/gif.latex?summer%20\rightarrow%20winter" alt="$summer \rightarrow winter$"></a>, and the bottom two rows are <a href="http://latex.codecogs.com/gif.latex?winter%20\rightarrow%20summer"><img src="http://latex.codecogs.com/gif.latex?winter%20\rightarrow%20summer" alt="$winter \rightarrow summer$"></a>.</center></p>

## Preparation

- **Prerequisites**
    - Tensorflow (r1.4 - r1.12 should work fine)
    - Python 3.x with matplotlib, numpy and scipy

- **Dataset**
    - [CelebA](http://openaccess.thecvf.com/content_iccv_2015/papers/Liu_Deep_Learning_Face_ICCV_2015_paper.pdf) dataset (Find more details from the [project page](http://mmlab.ie.cuhk.edu.hk/projects/CelebA.html))
        - [Images](https://drive.google.com/open?id=0B7EVK8r0v71pZjFTYXZWM3FlRnM) should be placed in ***DATAROOT/img_align_celeba/\*.jpg***
        - [Attribute labels](https://drive.google.com/open?id=0B7EVK8r0v71pblRyaVFSWGxPY0U) should be placed in ***DATAROOT/list_attr_celeba.txt***
        - If google drive is unreachable, you can get the data from [Baidu Cloud](http://pan.baidu.com/s/1eSNpdRG)
    - We follow the settings of AttGAN, kindly refer to [AttGAN](https://github.com/LynnHo/AttGAN-Tensorflow) for more dataset preparation details

- **pre-trained model**
    - download the model from [Google Drive](https://drive.google.com/open?id=1329IbLE6877DcDUut1reKxckijBJye7N) or [Baidu Cloud (4qeu)](https://pan.baidu.com/s/1D43d_8oER8_Xm4P9SovvuQ), and unzip the files to ***./output/***,

## Quick Start

Exemplar commands are listed here for a quick start.

### Training

- for 128x128 images

```console
    python train.py --experiment_name 128
    ```

- for 384x384 images (please prepare data according to [HD-CelebA](https://github.com/LynnHo/HD-CelebA-Cropper))

```console
    python train.py --experiment_name 384 --img_size 384 --enc_dim 48 --dec_dim 48 --dis_dim 48 --dis_fc_dim 512 --n_sample 24 --use_cropped_img
    ```

### Testing

- Example of testing ***single*** attribute

```console
    python test.py --experiment_name 128 [--test_int 1.0]
    ```

- Example of testing ***multiple*** attributes

```console
    python test.py --experiment_name 128 --test_atts Pale_Skin Male [--test_ints 1.0 1.0]
    ```

- Example of ***attribute intensity control***

```console
    python test.py --experiment_name 128 --test_slide --test_att Male [--test_int_min -1.0 --test_int_max 1.0 --n_slide 10]
    ```

The arguments in `[]` are optional with a default value.

### View Images

You can use `show_image.py` to show the generated images, the code has been tested on Windows 10 and Ubuntu 16.04 (python 3.6). If you want to change the width of the buttons in the bottom, you can change `width` parameter in the 160th line. the '+++' and '---' on the button indicate that the above image is modified to 'add' or 'remove' the attribute. Note that you should specify the path of the attribute file (`list_attr_celeba.txt`) of CelebA in the 82nd line.

### NOTE:

- You should give the path of the data by adding `--dataroot DATAROOT`;
- You can specify which GPU to use by adding `--gpu GPU`, e.g., `--gpu 0`;
- You can specify which image(s) to test by adding `--img num` (e.g., `--img 182638`, `--img 200000 200001 200002`), where the number should be no larger than 202599 and is suggested to be no smaller than 182638 as our test set starts at 182638.png.
- You can modify the model by using following arguments
    - `--label`: 'diff'(default) for difference attribute vector, 'target' for target attribute vector
    - `--stu_norm`: 'none'(default), 'bn' or 'in' for adding no/batch/instance normalization in STUs
    - `--mode`: 'wgan'(default), 'lsgan' or 'dcgan' for differenct GAN losses
    - More arguments please refer to [train.py](./train.py)

### AttGAN

- Train with AttGAN model by

```console
    python train.py --experiment_name attgan_128 --use_stu false --shortcut_layers 1 --inject_layers 1
    ```

## Citation
If you find STGAN useful in your research work, please consider citing:

@InProceedings{liu2019stgan,
      title={STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editing},
      author={Liu, Ming and Ding, Yukang and Xia, Min and Liu, Xiao and Ding, Errui and Zuo, Wangmeng and Wen, Shilei},
      booktitle={IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
      year={2019}
    }

## Acknowledgement
The code is built upon [AttGAN](https://github.com/LynnHo/AttGAN-Tensorflow), thanks for their excellent work!