ComfyUI Node: MiniMax-H3 Guide Prompt (any LLM)

MiniMax-H3 Guide Prompt (any LLM):

The MiniMaxH3GuidePrompt node is designed to generate structured audio-video descriptions using the MiniMax-H3 writing guide. This node allows you to create detailed prompts for various models without the need for LoRA (Low-Rank Adaptation), making it versatile and accessible for models that follow instructions. The guide is fetched from MiniMaxAI/MiniMax-H3 on first use, ensuring that you always have the latest version. This node is particularly beneficial for creating prompts that are compatible with a wide range of models, including those that can run on an 8 GB card, offering flexibility and efficiency in generating high-quality audio-video descriptions.

MiniMax-H3 Guide Prompt (any LLM) Input Parameters:

prompt

The prompt parameter is a string input that allows you to provide the initial text or idea that you want to expand into a structured MiniMax-H3 description. This parameter supports multiline input, enabling you to include detailed information or context. The default value is an empty string, and it serves as the foundation for the node to generate a comprehensive audio-video description.

task

The task parameter specifies the mode of operation for the node, allowing you to choose from various modes such as T2VA, I2VA, FL2VA, L2VA, and Ref2VA. Each mode corresponds to a different type of description, with Ref2VA using a full-reference guide with six output sections. The default mode is T2VA, and this parameter helps tailor the output to specific needs or formats.

resolution

The resolution parameter determines the aspect ratio of the output description, with options such as "16:9". This parameter ensures that the generated description aligns with the desired visual format, providing consistency and clarity in the output. The default resolution is "16:9", which is a common aspect ratio for video content.

duration

The duration parameter is an integer that specifies the length of the audio-video description in seconds. It has a default value of 10, with minimum and maximum values defined by DURATION_MIN and DURATION_MAX, respectively. This parameter allows you to control the temporal scope of the description, ensuring it fits within the desired timeframe.

reference_material

The reference_material parameter is an optional string input that provides additional context or information about the reference frames or assets. This is particularly important for the Ref2VA mode, where detailed reference information is required. The default value is an empty string, and it supports multiline input to accommodate comprehensive descriptions.

auto_download

The auto_download parameter is a boolean option that determines whether the guide should be automatically fetched from MiniMaxAI/MiniMax-H3 if it is not already present in the ComfyUI user directory. The default value is True, ensuring that you always have access to the latest guide without manual intervention.

MiniMax-H3 Guide Prompt (any LLM) Output Parameters:

rewritten_prompt

The rewritten_prompt output is a string that contains the structured audio-video description generated by the node. This output is the result of processing the input prompt and parameters through the MiniMax-H3 guide, providing a detailed and formatted description that can be used in various applications.

<section_name_1>

Each section name corresponds to a part of the output description, such as <Subject>, <Picture>, <Video>, <Audio>, and others, depending on the selected mode. These sections provide specific details about different aspects of the description, ensuring a comprehensive and organized output.

MiniMax-H3 Guide Prompt (any LLM) Usage Tips:

• Ensure that the prompt parameter is detailed and clear to achieve the best results in the generated description.
• Use the task parameter to select the appropriate mode for your needs, as each mode offers different output structures and details.

MiniMax-H3 Guide Prompt (any LLM) Common Errors and Solutions:

Guide not found

• Explanation: This error occurs when the guide is not available in the ComfyUI user directory and auto-download is disabled.
• Solution: Enable the auto_download parameter to fetch the guide automatically or manually download it from MiniMaxAI/MiniMax-H3.

Invalid duration value

• Explanation: The duration specified is outside the allowed range defined by DURATION_MIN and DURATION_MAX.
• Solution: Adjust the duration parameter to fall within the valid range to ensure proper execution.