ComfyUI Node: Prompt Relay Encode (Timeline)

Prompt Relay Encode (Timeline):

The PromptRelayEncodeTimeline node is designed to enhance the creative process by allowing you to visually edit local prompts and segment lengths as draggable blocks on a timeline. This node is particularly beneficial for AI artists who want to have precise control over the temporal aspects of their video projects. Unlike the standard Prompt Relay Encode, this variant provides a more intuitive, WYSIWYG (What You See Is What You Get) interface, making it easier to manage and adjust the timing and sequence of prompts. The timeline interface allows you to scale the timeline in pixel space using the max_frames input, although the actual frame count is determined by the latent input. This node is ideal for projects that require detailed temporal control and seamless transitions between different segments, offering a more interactive and user-friendly approach to prompt management.

Prompt Relay Encode (Timeline) Input Parameters:

model

This parameter represents the AI model used for processing the prompts and generating the output. It is essential for defining the capabilities and limitations of the node's execution.

clip

The clip input is used to provide the necessary context for the prompts. It helps in encoding the text prompts into a format that the model can understand and process.

latent

The latent input is an empty latent video whose dimensions are read from its shape. It serves as the canvas for the video generation process, determining the frame count and resolution.

global_prompt

This is a multiline string input that conditions the entire video. It anchors persistent characters, objects, and scene context, providing a consistent theme or narrative throughout the video.

local_prompts

A multiline string input where ordered prompts for each temporal segment are separated by a vertical bar (|). These prompts define the specific content or actions for each segment of the video.

segment_lengths

This input accepts a comma-separated list of pixel space frame counts for each segment. If left empty, the segments are auto-distributed evenly. It allows for precise control over the duration of each segment.

epsilon

A float input with a default value of 0.001, minimum of 0.000001, and maximum of 0.99. It acts as a penalty decay parameter, influencing the sharpness of boundaries between segments. Lower values produce sharper transitions, while higher values result in softer transitions.

relay_options

An optional input for advanced per-stream tuning. It allows you to connect a Prompt Relay Advanced Options node to fine-tune parameters such as video strength and audio settings.

Prompt Relay Encode (Timeline) Output Parameters:

patched

This output represents the modified model that has been patched with the encoded prompts. It is essential for ensuring that the model can generate the desired video content based on the provided prompts.

conditioning

The conditioning output provides the encoded conditions that guide the model's video generation process. It encapsulates the global and local prompts, segment lengths, and any advanced options applied.

Prompt Relay Encode (Timeline) Usage Tips:

• Utilize the timeline interface to visually adjust segment lengths and prompts, making it easier to manage complex projects with multiple segments.
• Experiment with different epsilon values to achieve the desired transition sharpness between segments. Lower values create distinct boundaries, while higher values offer smoother transitions.
• Use the relay_options input to fine-tune video and audio settings for more advanced control over the output.

Prompt Relay Encode (Timeline) Common Errors and Solutions:

"PromptRelay: 'global_prompt' arrived as None."

• Explanation: This error occurs when the global_prompt input is not provided or is set to None.
• Solution: Ensure that the global_prompt field is filled with a valid string or set to an empty string if not needed.

"At least one local prompt is required (separate with |)"

• Explanation: This error indicates that no local prompts have been provided, which are necessary for segment-specific content.
• Solution: Provide at least one local prompt, separated by a vertical bar (|) if multiple prompts are needed.

"PromptRelay: 'segment_lengths' arrived as None."

• Explanation: This error suggests that the segment_lengths input is missing or set to None.
• Solution: Ensure that segment_lengths is either filled with a comma-separated list of frame counts or left empty for auto-distribution.