OpenLipSync

This is a small repository containing all the required files to run inference for LatentSync1.5.

Installation

Clone the repo
On Debian-based systems, run bash debian_setup.sh for both local and modal (remote inference)
For remote inference with Modal, you must first create the volume by running:

uv run modal run scripts/modal_download_extras.py
uv run modal run scripts/modal_download_models.py

Modify the inference.py file at the root of the directory (add the path of your video and file). Then run with:

uv run inference.py

Modify the modal_lipsync_inference.py file at the root of the directory (add the path of your video and file). Then run with:

uv run modal run modal_lipsync_inference.py

Run:

uv run modal run modal_lipsync_serve.py