ByteDanceSlowHigh

LatentSync

ByteDance's open-source lipsync — re-syncs a video's mouth movements to any audio track using latent diffusion. State-of-the-art open lipsync quality for dubbing and localization.

220 credits

per run (runtime grows with video length)

Video + audio → lip-synced video

State-of-the-art open-source lipsync

Latent diffusion mouth re-generation

Guidance scale control

Run it right now

Test this model instantly in the Console Playground — no code required

Use with AI Assistant

Copy usage instructions for Claude, ChatGPT, or other AI

llms.txtllms.txt ↗

Quick Start

curl -X POST "https://api.core.today/v1/predictions" \
  -H "Content-Type: application/json" \
  -H "X-API-Key: cdt_your_api_key" \
  -d '{
  "model": "bytedance/latentsync",
  "input": {
    "video": "https://example.com/presenter.mp4",
    "audio": "https://example.com/korean-voiceover.mp3"
  }
}'

Parameters

Parameter	Type	Required	Default	Description
`video`	string	No	-	Input video with a visible face
`audio`	string	No	-	Audio track to sync the lips to
`guidance_scale`	number	No	1	Guidance scale for generation
`seed`	integer	No	0	Random seed (0 for random)

How to Provide File Input

There are 3 ways to provide files for the videoaudio parameters:

Recommended

Direct Upload (Multipart)

Attach files directly to POST /v1/predictions/upload. No separate upload step needed.

curl -X POST "https://api.core.today/v1/predictions/upload" \
  -H "X-API-Key: cdt_your_api_key" \
  -F "model=bytedance/latentsync" \
  -F 'input={"prompt":"your prompt here"}' \
  -F "file:video=@your_file.png"

Image URL

Pass a publicly accessible URL directly. You can also use file_url from the Storage API.

{
  "model": "bytedance/latentsync",
  "input": {
    "prompt": "your prompt here",
    "video": "https://example.com/image.jpg"
  }
}

See the File Upload docs for more upload methods including Presigned URLs.

Common Parameters

Common parameters used when calling POST /v1/predictions.

Parameter	Type	Required	Default	Description
`model`	string	Yes	-	Model identifier
`input`	object	Yes	-	Object containing the model-specific parameters from the table above
`output_folder`	string	No	-	Folder path for output files (max 256 chars, '..' not allowed)
`webhook_url`	string	No	-	Webhook URL to call on completion
`is_public`	boolean	No	false	If true, output files are also available via permanent public URLs

Examples

Dub a Presenter Video

Sync a presenter's lips to a new Korean voiceover

curl -X POST "https://api.core.today/v1/predictions" \
  -H "Content-Type: application/json" \
  -H "X-API-Key: cdt_your_api_key" \
  -d '{
  "model": "bytedance/latentsync",
  "input": {
    "video": "https://example.com/presenter.mp4",
    "audio": "https://example.com/korean-voiceover.mp3"
  }
}'