| license: openrail++ | |
| library_name: torchgeo | |
| tags: | |
| - lipsync | |
| - video-editing | |
| Paper: https://arxiv.org/abs/2412.09262 | |
| Code: https://github.com/bytedance/LatentSync | |
| # LatentSync 1.6 | |
| Many people have reported that the teeth and lips generated by LatentSync 1.5 are blurry. To address this issue, we trained LatentSync 1.6 on 512 x 512 resolution videos. | |
| Notably, we did not make any changes to the model structure or training strategy; the only modification was upgrading the training dataset to 512 x 512 videos. Therefore, the current code is compatible with both LatentSync 1.5 and 1.6. To switch between versions, you only need to load the corresponding checkpoint and modify the `resolution` parameter in the U-Net config file. | |
| You can view the [demo](https://github.com/bytedance/LatentSync/blob/main/docs/changelog_v1.6.md) in LatentSync's official GitHub repo. |