Pix2Gif

KO | EN

gitlite — search

#javascript #python #go #golang #machine-learning #rust #deep-learning #docker #awesome #awesome-list #vue #security #openai #open-source

(★ 13)

No description available.

Pix2Gif Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Pix2Gif: Motion-Guided Diffusion for GIF Generation
![teaser_op](https://github.com/hiteshK03/Pix2Gif/assets/45922320/3d8ca72e-b2f3-48fd-a732-574987454fd3)

:grapes: \[[arXiv](https://arxiv.org/abs/2403.04634)\] &nbsp; :apple: \[[Demo](https://520a83a7524ec7d864.gradio.live/)\] &nbsp; :orange: \[[Project Page](https://hiteshk03.github.io/Pix2Gif/)\]

[Hitesh Kandala](https://hiteshk03.github.io/)1, [Jianfeng Gao](https://www.microsoft.com/en-us/research/people/jfgao/)2, [Jianwei Yang](https://jwyang.github.io/)2
 Microsoft Research India1, Microsoft Research Redmond2

## Setup
### Set up python virtual environment
```bash
python3.10 -m venv .pix2gif
source .pix2gif/bin/activate
pip install torch==1.11.0+cu113 torchvision==0.12.0+cu113 torchaudio==0.11.0 --extra-index-url https://download.pytorch.org/whl/cu113
pip install -r requirements.txt
bash scripts/download_pretrained_sd.sh
```

## Demo
![github_demo](https://github.com/hiteshK03/Pix2Gif/assets/45922320/e3b1605c-b8e2-4ab7-8329-17d0b611e68b)
This demo takes in an image and a caption and generates a Gif following the input caption. To launch the demo, run:
```bash
python demo.py
```

## Acknowledgement
We build our work on top of [InstructPix2Pix](https://github.com/timothybrooks/instruct-pix2pix)

## Citation
```bibtex
@misc{kandala2024pix2gif,
      title={Pix2Gif: Motion-Guided Diffusion for GIF Generation}, 
      author={Hitesh Kandala and Jianfeng Gao and Jianwei Yang},
      year={2024},
      eprint={2403.04634},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Pix2Gif

Pix2Gif Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Pix2Gif

Pix2Gif Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README