POET

KO | EN

gitlite — search

#python #java #python3 #arduino #golang #machine-learning #rust #html #flask #javascript #seismology #nodejs

★ 21 Open GitHub ↗

No description available.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

## POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generation
- [POET](#poet)
  - [Abstract](#abstract)
  - [Environment Setup](#environment-setup)
  - [Pipeline](#pipeline)
  - [Personalization Demo](#personalization)
- [BibTeX](#citation)

## ✨ Abstract

Many large-scale text-to-image systems are designed for broad applicability, yielding conventional output that may limit creative exploration. They also employ interaction methods that may be difficult for beginners. Given that creative end-users often operate in diverse, context-specific ways that are often unpredictable, more variation and personalization are necessary. We introduce POET, a real-time interactive tool that
- automatically discovers dimensions of homogeneity in text-to-image generative models, 
- expands these dimensions to diversify the output space of generated images, and 
- learns from user feedback to personalize expansions.

POET offers a first glimpse of how interaction techniques of future text-to-image generation tools may support and align with more pluralistic values and the needs of end-users during the ideation stages of their work.

![teaser](https://raw.githubusercontent.com/evansh666/POET/main/assets/images/teaser.jpg)

## 🛠️ Environment Setup

- Create Anaconda Environment:
  
  ```bash
  git clone https://github.com/evansh666/POET.git
  cd POET
  ```
  
  ```bash
  conda create -n POET python=3.10
  conda activate POET
  conda install pytorch==2.4.0 torchvision==0.19.0 torchaudio==2.4.0 pytorch-cuda=12.4 -c pytorch -c nvidia
  ```
- Install other requirements:
  
  ```bash
  pip install -U -r requirements.txt
  ```

## 🔮 Pipeline

Here, we show an example of using our pipeline to generate personalized and creative images.
![pipeline_example](https://raw.githubusercontent.com/evansh666/POET/main/assets/images/pipeline.jpg)

Given a prompt, to generate and select a faithful image:
  ```bash
  python run.py --prompt "Design a superhero character."
  ```

## 🔥 Personalization

- Check our [demo](https://huggingface.co/spaces/PAI-GEN/POET) in Huggingface Space, supported by Gradio.

## 🚀 Citation

If you find our work useful, please consider citing:

```
@misc{han2025poetsupportingpromptingcreativity,
      title={POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generation}, 
      author={Evans Xu Han and Alice Qian Zhang and Hong Shen and Haiyi Zhu and Paul Pu Liang and Jane Hsieh},
      year={2025},
      eprint={2504.13392},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2504.13392}, 
}
```

## 📭 Contact

If you have any comments or questions, feel free to contact Xu Han(evanshan69@gmail.com).

## License

Please follow [CC-BY-NC](./LICENSE).

<hr>

POET

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README