One-to-All Animation: Pose-to-Motion Video Generation on playground and API | RunComfy
The professional 14-billion parameter edition. Delivers maximum visual fidelity, handles complex limb occlusions, and preserves fine details for studio-grade video-to-video animation.
Table of contents
1. Get started
Use RunComfy's API to run community/one-to-all-animation/14b. For accepted inputs and outputs, see the model's schema.
curl --request POST \
--url https://model-api.runcomfy.net/v1/models/community/one-to-all-animation/14b \
--header "Content-Type: application/json" \
--header "Authorization: Bearer <token>" \
--data '{
"prompt": "a woman is dancing",
"negative_prompt": "black background, Aerial view, aerial view, overexposed, low quality, deformation, a poor composition, bad hands, bad teeth, bad eyes, bad limbs, distortion",
"image_url": "https://playgrounds-storage-public.runcomfy.net/tools/7279/media-files/input-1-1.jpg",
"video_url": "https://playgrounds-storage-public.runcomfy.net/tools/7279/media-files/input-1-2.mp4"
}'2. Authentication
Set the YOUR_API_TOKEN environment variable with your API key (manage keys in your Profile) and include it on every request as a Bearer token via the Authorization header: Authorization: Bearer $YOUR_API_TOKEN.
3. API reference
Submit a request
Submit an asynchronous generation job and immediately receive a request_id plus URLs to check status, fetch results, and cancel.
curl --request POST \
--url https://model-api.runcomfy.net/v1/models/community/one-to-all-animation/14b \
--header "Content-Type: application/json" \
--header "Authorization: Bearer <token>" \
--data '{
"prompt": "a woman is dancing",
"negative_prompt": "black background, Aerial view, aerial view, overexposed, low quality, deformation, a poor composition, bad hands, bad teeth, bad eyes, bad limbs, distortion",
"image_url": "https://playgrounds-storage-public.runcomfy.net/tools/7279/media-files/input-1-1.jpg",
"video_url": "https://playgrounds-storage-public.runcomfy.net/tools/7279/media-files/input-1-2.mp4"
}'Monitor request status
Fetch the current state for a request_id ("in_queue", "in_progress", "completed", or "cancelled").
curl --request GET \
--url https://model-api.runcomfy.net/v1/requests/{request_id}/status \
--header "Authorization: Bearer <token>"Retrieve request results
Retrieve the final outputs and metadata for the given request_id; if the job is not complete, the response returns the current state so you can continue polling.
curl --request GET \
--url https://model-api.runcomfy.net/v1/requests/{request_id}/result \
--header "Authorization: Bearer <token>"Cancel a request
Cancel a queued job by request_id, in-progress jobs cannot be cancelled.
curl --request POST \
--url https://model-api.runcomfy.net/v1/requests/{request_id}/cancel \
--header "Authorization: Bearer <token>"4. File inputs
Hosted file (URL)
Provide a publicly reachable HTTPS URL. Ensure the host allows server‑side fetches (no login/cookies required) and isn't rate‑limited or blocking bots. Recommended limits: images ≤ 50 MB (~4K), videos ≤ 100 MB (~2–5 min @ 720p). Prefer stable or pre‑signed URLs for private assets.
5. Schema
Input schema
{
"type": "object",
"title": "Input",
"required": [
"prompt",
"negative_prompt",
"image_url",
"video_url"
],
"properties": {
"prompt": {
"title": "Prompt",
"description": "",
"type": "string",
"default": "a woman is dancing"
},
"negative_prompt": {
"title": "Negative Prompt",
"description": "",
"type": "string",
"default": "black background, Aerial view, aerial view, overexposed, low quality, deformation, a poor composition, bad hands, bad teeth, bad eyes, bad limbs, distortion"
},
"image_url": {
"title": "Image",
"description": "The URL of the image to use as a reference for the video generation.",
"type": "string",
"default": "https://playgrounds-storage-public.runcomfy.net/tools/7279/media-files/input-1-1.jpg"
},
"video_url": {
"title": "Video URL",
"description": "The URL of the video to use as a reference for the video generation.",
"type": "string",
"default": "https://playgrounds-storage-public.runcomfy.net/tools/7279/media-files/input-1-2.mp4"
},
"resolution": {
"title": "Resolution",
"description": "The resolution of the video to generate.",
"type": "string",
"enum": [
"480p",
"580p",
"720p"
],
"default": "480p"
},
"num_inference_steps": {
"title": "Number of Inference Steps",
"description": "The number of inference steps to use for the video generation.",
"type": "integer",
"minimum": 2,
"maximum": 30,
"default": 30
},
"image_guidance_scale": {
"title": "Image Guidance Scale",
"description": "The image guidance scale to use for the video generation.",
"type": "float",
"minimum": 1,
"maximum": 10,
"default": 2
},
"pose_guidance_scale": {
"title": "Pose Guidance Scale",
"description": "The pose guidance scale to use for the video generation.",
"type": "float",
"minimum": 1,
"maximum": 10,
"default": 1.5
}
}
}Output schema
{
"output": {
"type": "object",
"properties": {
"image": {
"type": "string",
"format": "uri",
"description": "single image URL"
},
"video": {
"type": "string",
"format": "uri",
"description": "single video URL"
},
"images": {
"type": "array",
"description": "multiple image URLs",
"items": { "type": "string", "format": "uri" }
},
"videos": {
"type": "array",
"description": "multiple video URLs",
"items": { "type": "string", "format": "uri" }
}
}
}
}RunComfy is the premier ComfyUI platform, offering ComfyUI online environment and services, along with ComfyUI workflows featuring stunning visuals. RunComfy also provides AI Models, enabling artists to harness the latest AI tools to create incredible art.