Google's fast multimodal video generation and editing model with native audio, using the Interactions API. Text-to-video, image-to-video, keyframe interpolation, reference-to-video, and video editing at 360p-4K.
Test this model instantly in the Console Playground โ no code required
Copy usage instructions for Claude, ChatGPT, or other AI
curl -X POST "https://api.core.today/v1/predictions" \
-H "Content-Type: application/json" \
-H "X-API-Key: cdt_your_api_key" \
-d '{
"model": "google/gemini-omni-1.1",
"input": {
"prompt": "A cinematic drone shot through misty pine mountains at sunrise, gentle wind and birdsong. No dialogue.",
"resolution": "720p",
"aspect_ratio": "16:9"
}
}'| Parameter | Type | Required | Default | Description |
|---|---|---|---|---|
prompt | string | Yes | - | Text prompt describing the video โ scene, camera movement, lighting, mood, and audio. Put anything to avoid in the prompt too (e.g. 'no dialogue') |
image | string | No | - | Starting image to animate into a video. When provided without last_frame, the video is generated from this image |
last_frame | string | No | - | Ending image. Together with image, the model interpolates a smooth transition between the two frames |
reference_images | array | No | [] | Reference images that guide the subject and style (not used as literal frames) โ e.g. specific characters or objects |
video | string | No | - | An existing video to edit. Describe the change in the prompt; the model preserves the rest. Billing uses the source video's measured length |
resolution | string | No | 720p | Output resolution. 360p is a fast draft mode. Billing per output second: 360p 116, 720p 349, 1080p 535, 4k 1046 credits 360p720p1080p4k |
aspect_ratio | string | No | 16:9 | Video aspect ratio. Ignored when editing an existing video 16:99:16 |
There are 3 ways to provide files for the imagelast_framereference_imagesvideo parameters:
Pass a publicly accessible URL directly. With the Storage API (POST /v1/files/upload-url) the file uploads straight to S3 (50MB per file) and you pass the returned file_url.
{
"model": "google/gemini-omni-1.1",
"input": {
"prompt": "your prompt here",
"image": "https://example.com/image.jpg"
}
}Attach files directly to POST /v1/predictions/upload. No separate upload step, but the bytes pass through the API server so the whole request is capped at 10MB.
curl -X POST "https://api.core.today/v1/predictions/upload" \
-H "X-API-Key: cdt_your_api_key" \
-F "model=google/gemini-omni-1.1" \
-F 'input={"prompt":"your prompt here"}' \
-F "file:image=@your_file.png"Common parameters used when calling POST /v1/predictions.
| Parameter | Type | Required | Default | Description |
|---|---|---|---|---|
model | string | Yes | - | Model identifier |
input | object | Yes | - | Object containing the model-specific parameters from the table above |
output_folder | string | No | - | Folder path for output files (max 256 chars, '..' not allowed) |
webhook_url | string | No | - | Webhook URL to call on completion |
is_public | boolean | No | false | If true, output files are also available via permanent public URLs |
Generate a cinematic clip with prompted soundscape
curl -X POST "https://api.core.today/v1/predictions" \
-H "Content-Type: application/json" \
-H "X-API-Key: cdt_your_api_key" \
-d '{
"model": "google/gemini-omni-1.1",
"input": {
"prompt": "A cinematic drone shot through misty pine mountains at sunrise, gentle wind and birdsong. No dialogue.",
"resolution": "720p",
"aspect_ratio": "16:9"
}
}'Edit existing footage while preserving everything else
curl -X POST "https://api.core.today/v1/predictions" \
-H "Content-Type: application/json" \
-H "X-API-Key: cdt_your_api_key" \
-d '{
"model": "google/gemini-omni-1.1",
"input": {
"prompt": "Make the sky stormy with distant thunder, keep everything else the same",
"video": "https://example.com/source.mp4",
"resolution": "720p"
}
}'Smooth transition between a start and end frame
curl -X POST "https://api.core.today/v1/predictions" \
-H "Content-Type: application/json" \
-H "X-API-Key: cdt_your_api_key" \
-d '{
"model": "google/gemini-omni-1.1",
"input": {
"prompt": "Smooth continuous timelapse from sunrise to sunset over the lake",
"image": "https://example.com/sunrise.jpg",
"last_frame": "https://example.com/sunset.jpg"
}
}'POST /v1/predictions