DreamBarbie

KO | EN

gitlite — search

#python #javascript #java #typescript #android #csharp #framework #deep-learning #machine-learning #python3 #cpp #express

★ 32 Open GitHub ↗

[TVCG 2026] Official repo of "DreamBarbie: Text to Barbie-Style 3D Avatars“

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# [TVCG 2026] DreamBarbie: Text to Barbie-Style 3D Avatars

<div>
    <a href="https://xiaokunsun.github.io"><strong>Xiaokun Sun</strong></a><sup>1</sup>,
    <a href="https://jessezhang92.github.io"><strong>Zhenyu Zhang</strong></a><sup>1*</sup>,
    <a href="https://tyshiwo.github.io/index.html"><strong>Ying Tai</strong></a><sup>1</sup>,
    <a href="https://ha0tang.github.io"><strong>Hao Tang</strong></a><sup>2</sup>,
    <a href="https://zili-yi.github.io"><strong>Zili Yi</strong></a><sup>1</sup>,
    <a href="https://scholar.google.com.hk/citations?user=6CIDtZQAAAAJ"><strong>Jian Yang</strong></a><sup>1</sup>
</div>

<div>
    <sup>1</sup><strong>Nanjing University</strong> &nbsp;&nbsp;
    <sup>2</sup><strong>Peking University</strong>
</div>

<div>
    <sup>*</sup><strong>Corresponding Author</strong>
</div>

<br>

[![ArXiv](https://img.shields.io/badge/ArXiv-2408.09126-b31b1b.svg)](https://arxiv.org/pdf/2408.09126)
[![Project Page](https://img.shields.io/badge/Project%20Page-DreamBarbie-ff69b4.svg)](https://xiaokunsun.github.io/DreamBarbie.github.io)
[![Gallery](https://img.shields.io/badge/Gallery-View-blue.svg)](https://drive.google.com/drive/folders/1FXDROWXrnsSQiOZ4vBgA_Yzib3irLNBc?usp=sharing)

## 🔨 Installation
Tested on **Ubuntu 20.04**, **Python 3.8**, **NVIDIA A6000**, **CUDA 11.7**, and **PyTorch 2.0.0**. Follow the steps below to set up the environment.

1. Clone the repo:
    ```bash
    git clone https://github.com/XiaokunSun/DreamBarbie.git
    cd DreamBarbie
    ```

2. Create a conda environment:
    ```bash
    conda create -n dreambarbie python=3.8 -y
    conda activate dreambarbie
    ```

3. Install dependencies:
    ```bash
    pip install torch==2.0.0 torchvision==0.15.1 torchaudio==2.0.1
    pip install -r requirements.txt
    pip install git+https://github.com/openai/CLIP.git
    pip install git+https://github.com/ashawkey/envlight.git
    pip install git+https://github.com/NVlabs/nvdiffrast.git --no-build-isolation
    pip install git+https://github.com/NVlabs/tiny-cuda-nn/#subdirectory=bindings/torch
    pip install git+https://github.com/KAIR-BAIR/nerfacc.git@v0.5.2
    pip install git+https://github.com/ashawkey/cubvh --no-build-isolation
    conda install https://anaconda.org/pytorch3d/pytorch3d/0.7.5/download/linux-64/pytorch3d-0.7.5-py38_cu117_pyt200.tar.bz2 # Note: Please ensure the pytorch3d version matches your Python, CUDA and Torch versions
    pip install git+https://github.com/bellockk/alphashape.git
    ```

4. Download pretrainedmodels:
    ```bash
    mkdir ./pretrained_models
    bash ./scripts/download_humannorm_models.sh
    python ./scripts/download_richdreamer_models.py
    cd ./pretrained_models && ln -s ~/.cache/huggingface ./
    cd ../
    ```

## 🕺 Inference
```bash
# Generate naked human
python ./scripts/generate_naked_human.py --dict_path ./load/dreambarbie/data_dict.json --naked_human_exp_root_dir ./outputs/naked_human --naked_human_idx 0:1:1 --gpu_idx 0
# Generate clothed human
python ./scripts/generate_clothed_human.py --dict_path ./load/dreambarbie/data_dict.json --naked_human_exp_root_dir ./outputs/naked_human --clothed_human_exp_root_dir ./outputs/clothed_human --naked_human_idx 0:1:1 --cloth_idx 0:1:1 --gpu_idx 0
# Generate human wearing overall
python ./scripts/generate_naked_human.py --dict_path ./load/dreambarbie/overall_data_dict.json --naked_human_exp_root_dir ./outputs/naked_human --naked_human_idx 0:1:1 --gpu_idx 0
python ./scripts/generate_clothed_overall_human.py --dict_path ./load/dreambarbie/overall_data_dict.json --naked_human_exp_root_dir ./outputs/naked_human --clothed_human_exp_root_dir ./outputs/clothed_overall_human --naked_human_idx 0:1:1 --cloth_idx 0:1:1 --gpu_idx 0
```

## 🪄 Application
```bash
# Apparel Combination
python ./scripts/apparel_combination.py
# Apparel Editing
python ./scripts/apparel_editing.py
# Animation
python ./scripts/animation.py
```
If you want to customize clothing templates, please see ```./scripts/smplx_cloth_mask.py```

## 💖 Acknowledgements
This repository is based on many amazing research works and open-source projects: [ThreeStudio](https://github.com/threestudio-project/threestudio), [HumanNorm](https://github.com/xhuangcv/humannorm), [RichDreamer](https://github.com/modelscope/richdreamer), [G-Shell](https://github.com/lzzcd001/GShell), etc. Thanks all the authors for their selfless contributions to the community!

## 📚 Citation
If you find our work helpful for your research, please consider starring this repository ⭐ and citing our work:
```bibtex
@article{sun2026dreambarbie,
  title={DreamBarbie: Text to Barbie-Style 3D Avatars},
  author={Sun, Xiaokun and Zhang, Zhenyu and Tai, Ying and Tang, Hao and Yi, Zili and Yang, Jian},
  journal={TVCG},
  year={2026}
}
```

DreamBarbie

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README