LatentSync
Taming Stable Diffusion for Lip Sync!
File Explorer
Download Latest Version (.zip)- demo1_audio.wav
- demo1_video.mp4
- demo2_audio.wav
- demo2_video.mp4
- demo3_audio.wav
- demo3_video.mp4
- syncnet_16_latent.yaml
- syncnet_16_pixel.yaml
- syncnet_16_pixel_attn.yaml
- syncnet_25_pixel.yaml
- stage1.yaml
- stage1_512.yaml
- stage2.yaml
- stage2_512.yaml
- stage2_efficient.yaml
- audio.yaml
- scheduler_config.json
- changelog_v1.5.md
- changelog_v1.6.md
- framework.png
- syncnet_arch.md
- __init__.py
- box_utils.py
- nets.py
- __init__.py
- README.md
- __init__.py
- syncnet.py
- syncnet_eval.py
- draw_syncnet_lines.py
- eval_fvd.py
- eval_sync_conf.py
- eval_sync_conf.sh
- eval_syncnet_acc.py
- eval_syncnet_acc.sh
- fvd.py
- hyper_iqa.py
- inference_videos.py
- syncnet_detect.py
- syncnet_dataset.py
- unet_dataset.py
- attention.py
- motion_module.py
- resnet.py
- stable_syncnet.py
- unet.py
- unet_blocks.py
- utils.py
- wav2lip_syncnet.py
- lipsync_pipeline.py
- __init__.py
- utils.py
- videomaev2_finetune.py
- videomaev2_pretrain.py
- __init__.py
- __init__.py
- data_utils.py
- metric_utils.py
- loss.py
- affine_transform.py
- audio.py
- av_reader.py
- face_detector.py
- image_processor.py
- mask.png
- mask2.png
- mask3.png
- mask4.png
- util.py
- merges.txt
- special_tokens_map.json
- tokenizer_config.json
- vocab.json
- added_tokens.json
- merges.txt
- special_tokens_map.json
- tokenizer_config.json
- vocab.json
- mel_filters.npz
- __init__.py
- basic.py
- english.json
- english.py
- __init__.py
- __main__.py
- audio.py
- decoding.py
- model.py
- tokenizer.py
- transcribe.py
- utils.py
- audio2feature.py
- affine_transform.py
- data_processing_pipeline.py
- detect_shot.py
- filter_high_resolution.py
- filter_visual_quality.py
- remove_broken_videos.py
- remove_incorrect_affined.py
- resample_fps_hz.py
- segment_videos.py
- sync_av.py
- inference.py
- train_syncnet.py
- train_unet.py
- count_total_videos_time.py
- download_web_videos.py
- move_files_recur.py
- occupy_gpu.py
- plot_videos_time_distribution.py
- remove_outdated_files.py
- write_fileslist.py
- .gitignore
- cog.yaml
- data_processing_pipeline.sh
- gradio_app.py
- inference.sh
- LICENSE
- predict.py
- README.md
- requirements.txt
- setup_env.sh
- train_syncnet.sh
- train_unet.sh
๐ Installation Guide
1. Get the code
git clone https://github.com/bytedance/LatentSync
Downloads the entire project code from GitHub to your computer.
cd LatentSync
Moves into the project folder you just downloaded.
2. Python
Easy RecommendedPrerequisites
python -m tools.write_fileslist
Runs the Python script (or module).
If it runs without errors and prints output in the terminal, it worked.
Pulled directly from this repo's README.
// repository documentation
Was this content helpful?
(0 ratings)