logo
RunComfy

Lipsync Video: Emotion-Aware Face Reanimation from Audio on playground and API | RunComfy

sync/react-1

Sync React-1 reanimates facial performance from audio or emotion prompts with identity-preserving lipsync video-to-video and audio-to-video edits up to 4K for filmmakers, localization, and post-production teams.

1. Get started

Use RunComfy's API to run sync/react-1. For accepted inputs and outputs, see the model's schema.

curl --request POST \
  --url https://model-api.runcomfy.net/v1/models/sync/react-1 \
  --header "Content-Type: application/json" \
  --header "Authorization: Bearer <token>" \
  --data '{
    "video_url": "https://playgrounds-storage-public.runcomfy.net/tools/7275/media-files/input-1-1.mp4",
    "audio_url": "https://playgrounds-storage-public.runcomfy.net/tools/7275/media-files/input-1-2.mp3"
  }'

2. Authentication

Set the YOUR_API_TOKEN environment variable with your API key (manage keys in your Profile) and include it on every request as a Bearer token via the Authorization header: Authorization: Bearer $YOUR_API_TOKEN.

3. API reference

Submit a request

Submit an asynchronous generation job and immediately receive a request_id plus URLs to check status, fetch results, and cancel.

curl --request POST \
  --url https://model-api.runcomfy.net/v1/models/sync/react-1 \
  --header "Content-Type: application/json" \
  --header "Authorization: Bearer <token>" \
  --data '{
    "video_url": "https://playgrounds-storage-public.runcomfy.net/tools/7275/media-files/input-1-1.mp4",
    "audio_url": "https://playgrounds-storage-public.runcomfy.net/tools/7275/media-files/input-1-2.mp3"
  }'

Monitor request status

Fetch the current state for a request_id ("in_queue", "in_progress", "completed", or "cancelled").

curl --request GET \
  --url https://model-api.runcomfy.net/v1/requests/{request_id}/status \
  --header "Authorization: Bearer <token>"

Retrieve request results

Retrieve the final outputs and metadata for the given request_id; if the job is not complete, the response returns the current state so you can continue polling.

curl --request GET \
  --url https://model-api.runcomfy.net/v1/requests/{request_id}/result \
  --header "Authorization: Bearer <token>"

Cancel a request

Cancel a queued job by request_id, in-progress jobs cannot be cancelled.

curl --request POST \
  --url https://model-api.runcomfy.net/v1/requests/{request_id}/cancel \
  --header "Authorization: Bearer <token>"

4. File inputs

Hosted file (URL)

Provide a publicly reachable HTTPS URL. Ensure the host allows server‑side fetches (no login/cookies required) and isn't rate‑limited or blocking bots. Recommended limits: images ≤ 50 MB (~4K), videos ≤ 100 MB (~2–5 min @ 720p). Prefer stable or pre‑signed URLs for private assets.

5. Schema

Input schema

{
  "type": "object",
  "title": "Input",
  "required": [
    "video_url",
    "audio_url"
  ],
  "properties": {
    "video_url": {
      "title": "Video URL",
      "description": "URL to the input video. Must be 15 seconds or shorter.",
      "type": "string",
      "default": "https://playgrounds-storage-public.runcomfy.net/tools/7275/media-files/input-1-1.mp4"
    },
    "audio_url": {
      "title": "Audio URL",
      "description": "URL to the input audio. Must be 15 seconds or shorter.",
      "type": "string",
      "default": "https://playgrounds-storage-public.runcomfy.net/tools/7275/media-files/input-1-2.mp3"
    },
    "emotion": {
      "title": "Emotion",
      "description": "Emotion prompt for the generation. Currently supports single-word emotions only.",
      "type": "string",
      "enum": [
        "happy",
        "angry",
        "sad",
        "neutral",
        "disgusted",
        "surprised"
      ],
      "default": "neutral"
    },
    "model_mode": {
      "title": "Model Mode",
      "description": "Controls the edit region and movement scope for the model.",
      "type": "string",
      "enum": [
        "lips",
        "face",
        "head"
      ],
      "default": "face"
    },
    "lipsync_mode": {
      "title": "Lipsync Mode",
      "description": "Lipsync mode when audio and video durations are out of sync.",
      "type": "string",
      "enum": [
        "cut_off",
        "loop",
        "bounce",
        "silence",
        "remap"
      ],
      "default": "bounce"
    },
    "temperature": {
      "title": "Temperature",
      "description": "Controls the expressiveness of the lipsync.",
      "type": "float",
      "default": 0.5,
      "minimum": 0,
      "maximum": 1
    }
  }
}

Output schema

{
  "output": {
    "type": "object",
    "properties": {
      "image": {
        "type": "string",
        "format": "uri",
        "description": "single image URL"
      },
      "video": {
        "type": "string",
        "format": "uri",
        "description": "single video URL"
      },
      "images": {
        "type": "array",
        "description": "multiple image URLs",
        "items": { "type": "string", "format": "uri" }
      },
      "videos": {
        "type": "array",
        "description": "multiple video URLs",
        "items": { "type": "string", "format": "uri" }
      }
    }
  }
}