SoniloFastStandard

Sonilo v1.1 Video to Sound Effects

Sonilo v1.1 video-to-sound-effects via Fal.AI. Adds AI-generated sound (ambience, effects, foley) to an input video — auto-captions the scene if no prompt is given, or accepts per-segment sound descriptions for finer control.

310 credits

per video (flat rate, regardless of length)

Adds ambience, sound effects, and foley to silent or under-scored video

Auto-captions the scene when no prompt is given

Per-segment sound descriptions for finer, time-ranged control

Output audio matches the input video's length automatically

Choice of AAC, MP3, WAV, or FLAC for the returned audio file

Billed as a flat rate per video, regardless of the video's length

Run it right now

Test this model instantly in the Console Playground — no code required

Use with AI Assistant

Copy usage instructions for Claude, ChatGPT, or other AI

llms.txtllms.txt ↗

Quick Start

curl -X POST "https://api.core.today/v1/predictions" \
  -H "Content-Type: application/json" \
  -H "X-API-Key: cdt_your_api_key" \
  -d '{
  "model": "sonilo/v1.1/video-to-sound-effects",
  "input": {
    "video_url": "https://storage.googleapis.com/falserverless/model_tests/video_models/mmaudio_input.mp4",
    "audio_format": "aac"
  }
}'

Parameters

Parameter	Type	Required	Default	Description
`prompt`	string	No	-	Optional. Describe the kind of sound you want; it steers the generated audio for every scene. Leave empty to caption the video automatically.
`video_url`	string	Yes	-	The video to add sound to (public URL, or upload a file). The generated audio matches the video's length.
`segments`	array	No	-	Optional. Split the video into time ranges, each with its own sound description. Leave empty to split into scenes automatically.
`audio_format`	string	No	aac	Format of the returned audio file: aac (default), mp3, wav, or flac. (The video with sound is always AAC.) wavmp3aacflac

How to Provide File Input

There are 3 ways to provide files for the video_url parameter:

Recommended

Direct Upload (Multipart)

Attach files directly to POST /v1/predictions/upload. No separate upload step needed.

curl -X POST "https://api.core.today/v1/predictions/upload" \
  -H "X-API-Key: cdt_your_api_key" \
  -F "model=sonilo/v1.1/video-to-sound-effects" \
  -F 'input={"prompt":"your prompt here"}' \
  -F "file:video_url=@your_file.png"

Image URL

Pass a publicly accessible URL directly. You can also use file_url from the Storage API.

{
  "model": "sonilo/v1.1/video-to-sound-effects",
  "input": {
    "prompt": "your prompt here",
    "video_url": "https://example.com/image.jpg"
  }
}

See the File Upload docs for more upload methods including Presigned URLs.

Common Parameters

Common parameters used when calling POST /v1/predictions.

Parameter	Type	Required	Default	Description
`model`	string	Yes	-	Model identifier
`input`	object	Yes	-	Object containing the model-specific parameters from the table above
`output_folder`	string	No	-	Folder path for output files (max 256 chars, '..' not allowed)
`webhook_url`	string	No	-	Webhook URL to call on completion
`is_public`	boolean	No	false	If true, output files are also available via permanent public URLs

Examples

Auto-captioned foley for silent footage

Add automatically generated ambience and sound effects to a silent video without specifying a prompt.

curl -X POST "https://api.core.today/v1/predictions" \
  -H "Content-Type: application/json" \
  -H "X-API-Key: cdt_your_api_key" \
  -d '{
  "model": "sonilo/v1.1/video-to-sound-effects",
  "input": {
    "video_url": "https://storage.googleapis.com/falserverless/model_tests/video_models/mmaudio_input.mp4",
    "audio_format": "aac"
  }
}'

Prompt-guided sound design

Steer the sound design with an explicit prompt and request the standalone audio track as WAV.

curl -X POST "https://api.core.today/v1/predictions" \
  -H "Content-Type: application/json" \
  -H "X-API-Key: cdt_your_api_key" \
  -d '{
  "model": "sonilo/v1.1/video-to-sound-effects",
  "input": {
    "video_url": "https://example.com/city-street-timelapse.mp4",
    "prompt": "Busy city street ambience with distant traffic, footsteps, and occasional car horns.",
    "audio_format": "wav"
  }
}'