LatentSync

by bytedance · Developer Tools

Taming Stable Diffusion for Lip Sync!

New0 ratings6,053 starsActive
Developer ToolsDeveloper ToolPythonShell
Open project ↗GitHub⚑ Report
LatentSync preview

About this project

LatentSync 🔥 Updates — 2025/06/11: We released LatentSync 1.6, which is trained on 512 $\times$ 512 resolution videos to mitigate the blurriness problem. Watch the demo here. — 2025/03/14: We released LatentSync 1.5, which (1) improves temporal consistency via adding temporal layer, (2) improves performance on Chinese videos and (3) reduces the VRAM requirement of the stage2 training to 20 GB through a series of optimizations. Learn more details here. 📖 Introduction We present LatentSync, an end-to-end lip-sync method based on audio-conditioned latent diffusion models without any intermediate motion representation, diverging from previous diffusion-based lip-sync…

Technologies

ShellPythonresearchdiffusion-modelslipsync

Project health

Inactive for over a year
Last updatelast year
Contributors12
Latest release
Open issues & PRs228
LicenseApache-2.0
On GitHubsince 2024

GitHub

6,053
stars
976
forks
12
contributors
228
open issues & PRs
Python
language
last year
last commit
View on GitHub ↗

Reviews

out of 5 · 0 ratings
★★★★★
0%
★★★★
0%
★★★
0%
★★
0%
0%
Sign in to write a review
No reviews yet
Be the first to review LatentSync.

Built by

bytedance
Imported from GitHub · not yet claimed on GitPalace
View developer pageSign in with GitHub to claim

Maintain bytedance/LatentSync? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like