zero-shot-video-to-text

KO | EN

gitlite — search

#python #android #javascript #java #game #linux #bot #cnn #telegram #cocoapods #swift #xcode

zero-shot-video-to-text

★ 75 Open GitHub ↗

No description available.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Official Implementation of [Zero-Shot Video Captioning with Evolving Pseudo-Tokens](https://arxiv.org/abs/2207.11100)

## Approach
![](https://raw.githubusercontent.com/YoadTew/zero-shot-video-to-text/main/git_images/Architecture.png)

## Example of capabilities
![](https://raw.githubusercontent.com/YoadTew/zero-shot-video-to-text/main/git_images/Examples.png)

## Usage

### To run captioning on a video:

```bash
$ python run.py 
--token_wise--randomized_prompt
--run_type caption_videos
--data_path examples/example_video.mp4
```

### To run captioning on a single image:

```bash
$ python run.py 
--token_wise --randomized_prompt
--run_type caption_images
--data_path examples/example_image.jpg
```

## Citation
Please cite our work if you use it in your research:
```
@article{tewel2022videocap,
  title={Zero-Shot Video Captioning with Evolving Pseudo-Tokens},
  author={Tewel, Yoad and Shalev, Yoav and Nadler, Roy and Schwartz, Idan and Wolf, Lior},
  journal={arXiv preprint arXiv:2207.11100},
  year={2022}
}
```

zero-shot-video-to-text

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README