ComfyUI > Nodes > ComfyUI > Grok Reference-to-Video

ComfyUI Node: Grok Reference-to-Video

Class Name

GrokVideoReferenceNode

Category
api node/video/Grok
Author
ComfyAnonymous (Account age: 763days)
Extension
ComfyUI
Latest Updated
2026-05-13
Github Stars
112.77K

How to Install ComfyUI

Install this extension via the ComfyUI Manager by searching for ComfyUI
  • 1. Click the Manager button in the main menu
  • 2. Select Custom Nodes Manager button
  • 3. Enter ComfyUI in the search bar
After installation, click the Restart button to restart ComfyUI. Then, manually refresh your browser to clear the cache and access the updated list of nodes.

Visit ComfyUI Online for ready-to-use ComfyUI environment

  • Free trial available
  • 16GB VRAM to 80GB VRAM GPU machines
  • 400+ preloaded models/nodes
  • Freedom to upload custom models/nodes
  • 200+ ready-to-run workflows
  • 100% private workspace with up to 200GB storage
  • Dedicated Support

Run ComfyUI Online

Grok Reference-to-Video Description

Generate videos using reference images for consistent aesthetic and thematic continuity in video production.

Grok Reference-to-Video:

The GrokVideoReferenceNode is designed to generate videos by leveraging reference images as both style and content guides. This node is particularly beneficial for artists and creators who wish to produce videos that maintain a consistent aesthetic or thematic continuity with existing visual materials. By using reference images, the node can effectively translate the visual characteristics and content cues from these images into dynamic video sequences. This capability allows for the creation of visually cohesive and stylistically rich videos, making it an invaluable tool for projects that require a high degree of visual fidelity and thematic alignment.

Grok Reference-to-Video Input Parameters:

model

The model parameter specifies the version of the Grok video generation model to be used. It determines the underlying algorithm and capabilities available for video creation. The default model is "grok-imagine-video," which is optimized for generating high-quality videos based on reference images. This parameter does not have a range of values but should be set to a valid model name.

image

The image parameter is a crucial input that provides the reference image used to guide the video generation process. It must be a single image, as multiple images are not supported. This image serves as the style and content reference, influencing the visual output of the generated video. The image should be in a format that can be converted to a base64 string for processing.

prompt

The prompt parameter is a textual input that provides additional guidance for the video generation. It can include descriptive elements or thematic instructions that the model will consider when creating the video. The prompt must be a non-empty string, with a minimum length requirement to ensure meaningful input.

resolution

The resolution parameter defines the output resolution of the generated video. It impacts the clarity and detail of the video, with higher resolutions providing more detail but potentially requiring more processing power and time.

duration

The duration parameter specifies the length of the generated video in seconds. It determines how long the video will run, affecting the overall storytelling and pacing of the content.

aspect_ratio

The aspect_ratio parameter sets the width-to-height ratio of the video. It can be set to "auto" to automatically determine the best aspect ratio based on the input image or specified manually to fit specific requirements.

seed

The seed parameter is used to initialize the random number generator for the video generation process. It allows for reproducibility of results, meaning the same seed will produce the same video output given the same inputs.

Grok Reference-to-Video Output Parameters:

video

The video output parameter provides the final generated video file. This video is the result of the node's processing, incorporating the style and content from the reference image and any additional guidance from the prompt. The video is delivered in a format suitable for playback and further editing or distribution.

Grok Reference-to-Video Usage Tips:

  • Ensure that the reference image is of high quality and clearly represents the style or content you wish to convey in the video to achieve the best results.
  • Use a well-crafted prompt to provide additional context or thematic direction for the video, enhancing the alignment between the reference image and the final output.
  • Experiment with different resolutions and aspect ratios to find the optimal settings for your specific project needs, balancing quality and performance.

Grok Reference-to-Video Common Errors and Solutions:

"Only one input image is supported."

  • Explanation: This error occurs when multiple images are provided as input, but the node only supports a single reference image.
  • Solution: Ensure that you are providing only one image as input to the node. Remove any additional images and try again.

"Prompt must be a non-empty string."

  • Explanation: This error indicates that the prompt input is either empty or does not meet the minimum length requirement.
  • Solution: Provide a meaningful prompt that meets the minimum length requirement to guide the video generation process effectively.

Grok Reference-to-Video Related Nodes

Go back to the extension to check out more related nodes.
ComfyUI
RunComfy
Copyright 2025 RunComfy. All Rights Reserved.

RunComfy is the premier ComfyUI platform, offering ComfyUI online environment and services, along with ComfyUI workflows featuring stunning visuals. RunComfy also provides AI Models, enabling artists to harness the latest AI tools to create incredible art.

Grok Reference-to-Video