Wan 2.6: High-Fidelity video-to-video Lip-Sync & Motion Transfer on playground and API | RunComfy
Wan 2.6 transforms reference videos and prompts into 1080p, 24fps clips with realistic lip-sync, multi-shot storytelling, and precise motion transfer for easy, production-ready video creation.
Table of contents
1. Get started
Use RunComfy's API to run wan-ai/wan-2-6/video-to-video. For accepted inputs and outputs, see the model's schema.
curl --request POST \
--url https://model-api.runcomfy.net/v1/models/wan-ai/wan-2-6/video-to-video \
--header "Content-Type: application/json" \
--header "Authorization: Bearer <token>" \
--data '{
"prompt": "Overall Description: This video depicts a nostalgic, cinematic journey through a sun-drenched vintage street during the golden hour. The atmosphere is warm, peaceful, and reminiscent of an old film, focusing on the interplay of light, shadow, and historical architecture. \n Shot 1 [0-4 seconds]: A slow, sweeping tracking shot moves through the vintage street, capturing the golden-hour glow. character1 is walking leisurely along the sidewalk, bathed in warm sunlight. The lens flares dance as the light filters through the gaps between historic buildings, casting long, dramatic shadows around character1. \nShot 2 [4-7 seconds]: The camera continues to track as a classic car glides smoothly across the frame near character1. The car's polished surface reflects the warm hues of the setting sun, creating a contrast with the textured old buildings. \nShot 3 [7-10 seconds]: The focus shifts to the atmospheric details. Dust particles shimmer in the light around character1. The scene evokes a deep sense of nostalgia as character1 moves in the background, completing the cinematic vintage atmosphere.",
"reference_video_url_1": "https://playgrounds-storage-public.runcomfy.net/tools/7278/media-files/reference_video_1.mp4"
}'2. Authentication
Set the YOUR_API_TOKEN environment variable with your API key (manage keys in your Profile) and include it on every request as a Bearer token via the Authorization header: Authorization: Bearer $YOUR_API_TOKEN.
3. API reference
Submit a request
Submit an asynchronous generation job and immediately receive a request_id plus URLs to check status, fetch results, and cancel.
curl --request POST \
--url https://model-api.runcomfy.net/v1/models/wan-ai/wan-2-6/video-to-video \
--header "Content-Type: application/json" \
--header "Authorization: Bearer <token>" \
--data '{
"prompt": "Overall Description: This video depicts a nostalgic, cinematic journey through a sun-drenched vintage street during the golden hour. The atmosphere is warm, peaceful, and reminiscent of an old film, focusing on the interplay of light, shadow, and historical architecture. \n Shot 1 [0-4 seconds]: A slow, sweeping tracking shot moves through the vintage street, capturing the golden-hour glow. character1 is walking leisurely along the sidewalk, bathed in warm sunlight. The lens flares dance as the light filters through the gaps between historic buildings, casting long, dramatic shadows around character1. \nShot 2 [4-7 seconds]: The camera continues to track as a classic car glides smoothly across the frame near character1. The car's polished surface reflects the warm hues of the setting sun, creating a contrast with the textured old buildings. \nShot 3 [7-10 seconds]: The focus shifts to the atmospheric details. Dust particles shimmer in the light around character1. The scene evokes a deep sense of nostalgia as character1 moves in the background, completing the cinematic vintage atmosphere.",
"reference_video_url_1": "https://playgrounds-storage-public.runcomfy.net/tools/7278/media-files/reference_video_1.mp4"
}'Monitor request status
Fetch the current state for a request_id ("in_queue", "in_progress", "completed", or "cancelled").
curl --request GET \
--url https://model-api.runcomfy.net/v1/requests/{request_id}/status \
--header "Authorization: Bearer <token>"Retrieve request results
Retrieve the final outputs and metadata for the given request_id; if the job is not complete, the response returns the current state so you can continue polling.
curl --request GET \
--url https://model-api.runcomfy.net/v1/requests/{request_id}/result \
--header "Authorization: Bearer <token>"Cancel a request
Cancel a queued job by request_id, in-progress jobs cannot be cancelled.
curl --request POST \
--url https://model-api.runcomfy.net/v1/requests/{request_id}/cancel \
--header "Authorization: Bearer <token>"4. File inputs
Hosted file (URL)
Provide a publicly reachable HTTPS URL. Ensure the host allows server‑side fetches (no login/cookies required) and isn't rate‑limited or blocking bots. Recommended limits: images ≤ 50 MB (~4K), videos ≤ 100 MB (~2–5 min @ 720p). Prefer stable or pre‑signed URLs for private assets.
5. Schema
Input schema
{
"type": "object",
"title": "Input",
"required": [
"prompt",
"img_url",
"reference_video_url_1"
],
"properties": {
"prompt": {
"title": "Prompt",
"description": "Length should be less than 1500 characters. According to the order of the reference videos, refer to the reference videos as characterX. For example, when there are two reference videos, the prompt should be written as character1 singing on the side of the road and character2 dancing next to him. When there is a single reference, you also need to write character1 with 1. ",
"type": "string",
"default": "Overall Description: This video depicts a nostalgic, cinematic journey through a sun-drenched vintage street during the golden hour. The atmosphere is warm, peaceful, and reminiscent of an old film, focusing on the interplay of light, shadow, and historical architecture. \n Shot 1 [0-4 seconds]: A slow, sweeping tracking shot moves through the vintage street, capturing the golden-hour glow. character1 is walking leisurely along the sidewalk, bathed in warm sunlight. The lens flares dance as the light filters through the gaps between historic buildings, casting long, dramatic shadows around character1. \nShot 2 [4-7 seconds]: The camera continues to track as a classic car glides smoothly across the frame near character1. The car's polished surface reflects the warm hues of the setting sun, creating a contrast with the textured old buildings. \nShot 3 [7-10 seconds]: The focus shifts to the atmospheric details. Dust particles shimmer in the light around character1. The scene evokes a deep sense of nostalgia as character1 moves in the background, completing the cinematic vintage atmosphere."
},
"reference_video_url_1": {
"title": "Reference Video 1",
"description": "Video format must be: mp4, mov. The duration of this video must be between 2s and 30s. The file size must be less than 100 MB. When you only use this input, the longest reference is 5s. ",
"type": "string",
"default": "https://playgrounds-storage-public.runcomfy.net/tools/7278/media-files/reference_video_1.mp4"
},
"reference_video_url_2": {
"title": "Reference Video 2",
"description": "Video format must be: mp4, mov. The duration of this video must be between 2s and 30s. The file size must be less than 100 MB. When you use this input and Reference Video 1, the longest reference is 2.5s each.",
"type": "string"
},
"reference_video_url_3": {
"title": "Reference Video 3",
"description": "Video format must be: mp4, mov. The duration of this video must be between 2s and 30s. The file size must be less than 100 MB. When you use this input and Reference Video 1 and Reference Video 2, the longest reference is 1.66s each.",
"type": "string"
},
"duration": {
"title": "Duration",
"description": "",
"type": "integer",
"enum": [
5,
10
],
"default": 5
},
"size": {
"title": "Resolution",
"description": "",
"type": "string",
"enum": [
"1280*720",
"720*1280",
"960*960",
"1088*832",
"832*1088",
"1920*1080",
"1080*1920",
"1440*1440",
"1632*1248",
"1248*1632"
],
"default": "1280*720"
},
"shot_type": {
"title": "Shot Type",
"description": "Shot Type",
"type": "string",
"enum": [
"multi",
"single"
],
"default": "multi"
},
"negative_prompt": {
"title": "Negative Prompt",
"description": "",
"type": "string"
}
}
}Output schema
{
"output": {
"type": "object",
"properties": {
"image": {
"type": "string",
"format": "uri",
"description": "single image URL"
},
"video": {
"type": "string",
"format": "uri",
"description": "single video URL"
},
"images": {
"type": "array",
"description": "multiple image URLs",
"items": { "type": "string", "format": "uri" }
},
"videos": {
"type": "array",
"description": "multiple video URLs",
"items": { "type": "string", "format": "uri" }
}
}
}
}RunComfy is the premier ComfyUI platform, offering ComfyUI online environment and services, along with ComfyUI workflows featuring stunning visuals. RunComfy also provides AI Models, enabling artists to harness the latest AI tools to create incredible art.
