Use RunComfy's API to run google/gemini-omni-flash/reference-to-video. For accepted inputs and outputs, see the model's schema.
curl --request POST \
--url https://model-api.runcomfy.net/v1/models/google/gemini-omni-flash/reference-to-video \
--header "Content-Type: application/json" \
--header "Authorization: Bearer <token>" \
--data '{
"prompt": "The character from the reference walks forward through a sunlit forest clearing, dappled light moving across the scene as the camera slowly tracks alongside, leaves rustling and soft birdsong in the background.",
"image_urls": [
"https://playgrounds-storage-public.runcomfy.net/tools/7388/media-files/input-1-1.png"
]
}'Set the YOUR_API_TOKEN environment variable with your API key (manage keys in your Profile) and include it on every request as a Bearer token via the Authorization header: Authorization: Bearer $YOUR_API_TOKEN.
Submit an asynchronous generation job and immediately receive a request_id plus URLs to check status, fetch results, and cancel.
curl --request POST \
--url https://model-api.runcomfy.net/v1/models/google/gemini-omni-flash/reference-to-video \
--header "Content-Type: application/json" \
--header "Authorization: Bearer <token>" \
--data '{
"prompt": "The character from the reference walks forward through a sunlit forest clearing, dappled light moving across the scene as the camera slowly tracks alongside, leaves rustling and soft birdsong in the background.",
"image_urls": [
"https://playgrounds-storage-public.runcomfy.net/tools/7388/media-files/input-1-1.png"
]
}'Fetch the current state for a request_id ("in_queue", "in_progress", "completed", or "cancelled").
curl --request GET \
--url https://model-api.runcomfy.net/v1/requests/{request_id}/status \
--header "Authorization: Bearer <token>"Retrieve the final outputs and metadata for the given request_id; if the job is not complete, the response returns the current state so you can continue polling.
curl --request GET \
--url https://model-api.runcomfy.net/v1/requests/{request_id}/result \
--header "Authorization: Bearer <token>"Cancel a queued job by request_id; in-progress jobs cannot be cancelled.
curl --request POST \
--url https://model-api.runcomfy.net/v1/requests/{request_id}/cancel \
--header "Authorization: Bearer <token>"Provide a publicly reachable HTTPS URL. Ensure the host allows server-side fetches (no login/cookies required) and isn't rate-limited or blocking bots. Recommended limits: images ≤ 50 MB (~4K), videos ≤ 100 MB (~2–5 min @ 720p). Prefer stable or pre-signed URLs for private assets.
{
"type": "object",
"title": "Input schema",
"required": [
"prompt",
"image_urls"
],
"properties": {
"prompt": {
"title": "Prompt",
"description": "Describe the motion, scene development, pacing, and audio you want. You can direct camera work and sound (e.g. \"slow push-in\", \"gentle wind and birdsong\", \"no dialogue\") and add negative instructions such as \"Do not show text\". Reference the uploaded images inline to bind them to subjects, style, or layout.",
"type": "string",
"default": "The character from the reference walks forward through a sunlit forest clearing, dappled light moving across the scene as the camera slowly tracks alongside, leaves rustling and soft birdsong in the background."
},
"image_urls": {
"title": "Reference Images",
"description": "One or more reference images that guide the subject, style, layout, and visual direction of the video. Supported formats include jpg, jpeg, png, webp.",
"type": "array",
"items": {
"type": "string",
"format": "image_uri"
},
"minItems": 1,
"default": [
"https://playgrounds-storage-public.runcomfy.net/tools/7388/media-files/input-1-1.png"
]
},
"aspect_ratio": {
"title": "Aspect Ratio",
"description": "The aspect ratio of the generated video.",
"type": "string",
"enum": [
"16:9",
"9:16"
],
"default": "16:9"
},
"duration": {
"title": "Duration (seconds)",
"description": "The duration of the generated video, in seconds.",
"type": "integer",
"minimum": 3,
"maximum": 10,
"default": 8
}
}
}{
"output": {
"type": "object",
"properties": {
"image": {
"type": "string",
"format": "uri",
"description": "single image URL"
},
"video": {
"type": "string",
"format": "uri",
"description": "single video URL"
},
"images": {
"type": "array",
"description": "multiple image URLs",
"items": {
"type": "string",
"format": "uri"
}
},
"videos": {
"type": "array",
"description": "multiple video URLs",
"items": {
"type": "string",
"format": "uri"
}
}
}
}
}RunComfy is the premier ComfyUI platform, offering ComfyUI online environment and services, along with ComfyUI workflows featuring stunning visuals. RunComfy also provides AI Models, enabling artists to harness the latest AI tools to create incredible art.