SwiftI2V

KO | EN

gitlite — search

#javascript #react #llm #golang #android #deep-learning #linux #macos #awesome #kubernetes #vue #security #mcp #open-source

(★ 85)

[arXiv 2026] Project page for paper "SwiftI2V: Efficient High-Resolution Image-to-Video Generation via Conditional Segment-wise Generation"

SwiftI2V Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<h1>Efficient High-Resolution Image-to-Video Generation via Conditional Segment-wise Generation</h1>

**[YaoYang Liu](https://github.com/LazySheeeeeep)1 · Yuechen Zhang2 · Wenbo Li3 · Yufei Zhao4 · Rui Liu5 · Long Chen1,\***

1HKUST &nbsp;·&nbsp; 2CUHK &nbsp;·&nbsp; 3Joy Future Academy &nbsp;·&nbsp; 4HKU &nbsp;·&nbsp; 5HUAWEI Research
 
* Corresponding author

[![arXiv](https://img.shields.io/badge/arXiv-2605.06356-b31b1b.svg?style=flat-square)](https://arxiv.org/abs/2605.06356)
[![Project Page](https://img.shields.io/badge/Project-Page-blue?style=flat-square)](https://hkust-longgroup.github.io/SwiftI2V/)

2K (2560×1408) image-to-video generation — 81 frames in ~111s on a single H800, and runnable on a single RTX 4090 (24 GB).

</div>

---

## 📢 News

- **[2026-05]** 📄 arXiv preprint released: [arXiv:2605.06356](https://arxiv.org/abs/2605.06356)
- **[2026-05]** 🌐 Project page online: [hkust-longgroup.github.io/SwiftI2V](https://hkust-longgroup.github.io/SwiftI2V/)
- Code and checkpoints will be released in this repository &mdash; stay tuned!

## ✨ Highlights

- 🚀 **202× less GPU-time** than end-to-end 2K I2V baselines
- 🖼️ **Native 2K** (2560×1408) generation at **81 frames**
- 💻 **Single consumer RTX 4090 (24 GB)** is enough — no data-center GPU required
- 🧩 **Conditional Segment-wise Generation (CSG)** with bidirectional contextual interaction — memory-bounded regardless of video length
- 🎯 **Stage-transition training** closes the train&ndash;test gap between Stage&nbsp;I and Stage&nbsp;II

## 📖 Overview

Image-to-video (I2V) generation has made rapid progress, yet scaling to **high resolution** (e.g., 2K) is bottlenecked by the efficiency&ndash;fidelity dilemma: end-to-end high-resolution generators deliver strong quality but require tens of thousands of GPU-seconds per clip, while low-resolution generation followed by video super-resolution (VSR) loses the input-image condition and hallucinates details inconsistent with the reference.

**SwiftI2V** is an efficient two-stage framework that resolves this dilemma:

- **Stage I** produces a low-resolution motion reference with a large backbone under few-step sampling.
- **Stage II** refines it to 2K, conditioned on both the *input image* and the Stage&nbsp;I output.
- **Conditional Segment-wise Generation (CSG)** divides the temporal axis into bounded segments augmented by neighboring contexts, keeping peak memory roughly constant regardless of total length.
- **Stage-transition training** simulates Stage&nbsp;I-style artifacts during Stage&nbsp;II training to close the train&ndash;test gap.

On VBench-I2V at 2K, SwiftI2V matches strong end-to-end baselines on key I2V metrics while reducing total GPU-time by **202×**.

## 🏗️ Method

<img src="./static/images/method.png" alt="SwiftI2V two-stage pipeline" width="100%"/>

Overall two-stage pipeline of SwiftI2V.

<img src="./static/images/CSG.png" alt="Conditional Segment-wise Generation" width="80%"/>

Conditional Segment-wise Generation (CSG) with bidirectional contextual interaction.

## 🎥 Demo

For the full gallery, qualitative comparisons, ablations, and RTX 4090 results, please visit our **[Project Page](https://hkust-longgroup.github.io/SwiftI2V/)**.

## 📋 TODO

- ✅️ Release project page
- ✅️ Release arXiv paper
- [ ] Release inference code
- [ ] Release Stage I / Stage II checkpoints

## 📝 Citation

If you find SwiftI2V useful in your research, please consider citing:

```bibtex
@misc{liu2026swifti2vefficienthighresolutionimagetovideo,
      title={SwiftI2V: Efficient High-Resolution Image-to-Video Generation via Conditional Segment-wise Generation},
      author={YaoYang Liu and Yuechen Zhang and Wenbo Li and Yufei Zhao and Rui Liu and Long Chen},
      year={2026},
      eprint={2605.06356},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2605.06356}
}
```

## 🙏 Acknowledgements

We gratefully acknowledge the following open-source projects that made this work possible:

- [**Wan**](https://github.com/Wan-Video) &mdash; the video generation foundation model we build upon.
- [**DiffSynth-Studio**](https://github.com/modelscope/DiffSynth-Studio) &mdash; for its flexible diffusion training and inference framework.
- [**LightX2V**](https://github.com/ModelTC/LightX2V) &mdash; for its efficient inference utilities.

The project page design is adapted from the [Nerfies](https://nerfies.github.io/) academic template ([CC BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/)).

SwiftI2V

SwiftI2V Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

SwiftI2V

SwiftI2V Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README