CogVLMMediumHigh

CogVLM2 Video

Video understanding and captioning — ask free-form questions about a video and get detailed answers about actions, scenes, and content. Great for video search indexing and moderation prep.

28 credits

per video query

Free-form questions about video content

Action and scene understanding

Detailed multi-sentence answers

Temperature/top_p generation controls

Run it right now

Test this model instantly in the Console Playground — no code required

Use with AI Assistant

Copy usage instructions for Claude, ChatGPT, or other AI

llms.txtllms.txt ↗

Quick Start

curl -X POST "https://api.core.today/v1/predictions" \
  -H "Content-Type: application/json" \
  -H "X-API-Key: cdt_your_api_key" \
  -d '{
  "model": "chenxwh/cogvlm2-video",
  "input": {
    "input_video": "https://example.com/clip.mp4",
    "prompt": "Describe this video in detail, including actions and scene changes."
  }
}'

Parameters

Parameter	Type	Required	Default	Description
`prompt`	string	No	Describe this video.	Question or instruction about the video
`input_video`	string	Yes	-	Video to analyze
`top_p`	number	No	0.1	When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens
`temperature`	number	No	0.1	Sampling temperature
`max_new_tokens`	integer	No	2048	Maximum answer length

How to Provide File Input

There are 3 ways to provide files for the input_video parameter:

Recommended

Direct Upload (Multipart)

Attach files directly to POST /v1/predictions/upload. No separate upload step needed.

curl -X POST "https://api.core.today/v1/predictions/upload" \
  -H "X-API-Key: cdt_your_api_key" \
  -F "model=chenxwh/cogvlm2-video" \
  -F 'input={"prompt":"your prompt here"}' \
  -F "file:input_video=@your_file.png"

Image URL

Pass a publicly accessible URL directly. You can also use file_url from the Storage API.

{
  "model": "chenxwh/cogvlm2-video",
  "input": {
    "prompt": "your prompt here",
    "input_video": "https://example.com/image.jpg"
  }
}

See the File Upload docs for more upload methods including Presigned URLs.

Common Parameters

Common parameters used when calling POST /v1/predictions.

Parameter	Type	Required	Default	Description
`model`	string	Yes	-	Model identifier
`input`	object	Yes	-	Object containing the model-specific parameters from the table above
`output_folder`	string	No	-	Folder path for output files (max 256 chars, '..' not allowed)
`webhook_url`	string	No	-	Webhook URL to call on completion
`is_public`	boolean	No	false	If true, output files are also available via permanent public URLs

Examples

Video Summary

Get a detailed description of what happens in a clip

curl -X POST "https://api.core.today/v1/predictions" \
  -H "Content-Type: application/json" \
  -H "X-API-Key: cdt_your_api_key" \
  -d '{
  "model": "chenxwh/cogvlm2-video",
  "input": {
    "input_video": "https://example.com/clip.mp4",
    "prompt": "Describe this video in detail, including actions and scene changes."
  }
}'