ComfyUI Node: MiniMax H3 Reference Video Fade (Experimental)

MiniMax H3 Reference Video Fade (Experimental):

The MiniMaxH3ReferenceVideoFadeModelPatch is an experimental node designed to enhance the flexibility and control of the MiniMax H3 model when working with reference videos during the denoising process. This node introduces a fading mechanism that gradually reduces the influence of reference video data as the denoising progresses, allowing for more nuanced and controlled outputs. By applying a half-cosine fade to the value rows associated with native video and video-audio reference blocks, the node ensures that the reference video contributes fully at the beginning of the denoising process and fades out towards the end. This approach helps in maintaining the desired level of influence from the reference video without overwhelming the final output with unwanted elements such as source color or texture. The node is particularly useful for artists looking to achieve precise motion transfer while keeping other aspects of the render intact. It integrates seamlessly with existing attention overrides like SolAttn or Comfy Kitchen, ensuring that the overall attention mechanism remains efficient and effective.

MiniMax H3 Reference Video Fade (Experimental) Input Parameters:

model

This parameter expects a MiniMax H3 AV model, which serves as the base model to be patched. It is crucial that this model is placed after any backend or model patches and routed through every sampler stage to ensure the patch is applied correctly.

preset

The preset parameter allows you to choose from predefined fading schedules: "full", "balanced", "freer", "early_only", and "custom". Each option dictates how the reference video influence fades during denoising. For example, "balanced" maintains full influence through 67% of the process before fading to 20%, while "early_only" fades to zero after 50%. The default is "balanced".

custom_fade_start

This parameter is used when the preset is set to "custom". It defines the fraction of the denoising schedule during which the native video references remain at full strength. The value ranges from 0.0 to 1.0, with a default of 0.67, allowing for precise control over when the fade begins.

custom_end_strength

Also applicable when using the "custom" preset, this parameter specifies the strength of the native video-reference value at the end of the denoising process. It ranges from 0.0 to 1.0, with a default of 0.20, enabling you to determine how much influence the reference video retains at the conclusion of denoising.

full_sigmas

This optional parameter allows you to provide a custom schedule override for sigma values, which can be used to fine-tune the fading process further. If not provided, the node uses the sampler-provided schedule.

MiniMax H3 Reference Video Fade (Experimental) Output Parameters:

model

The output is a patched version of the MiniMax H3 AV model. This model incorporates the reference video fade mechanism, allowing for controlled influence of reference videos during the denoising process. The patched model retains all original functionalities while adding the capability to manage reference video contributions effectively.

MiniMax H3 Reference Video Fade (Experimental) Usage Tips:

• To achieve a subtle influence from the reference video, use the "balanced" preset, which provides a good starting point for most scenarios by maintaining full influence through 67% of the denoising process.
• For more control, switch to the "custom" preset and adjust the custom_fade_start and custom_end_strength parameters to fine-tune when and how much the reference video fades.
• Ensure that the model is correctly routed through every sampler stage to apply the patch effectively.

MiniMax H3 Reference Video Fade (Experimental) Common Errors and Solutions:

H3 Reference Video Fade requires a ComfyUI MODEL input.

• Explanation: This error occurs when the input model is not compatible or not provided correctly.
• Solution: Ensure that you are using a valid MiniMax H3 AV model as input and that it is correctly placed in the node sequence.

H3 Reference Video Fade only supports MiniMax H3 AV models.

• Explanation: The node is designed specifically for MiniMax H3 AV models and will not work with other model types.
• Solution: Verify that the model you are using is a MiniMax H3 AV model. If not, switch to a compatible model.

H3 Reference Video Fade is already installed on this MODEL.

• Explanation: This error indicates that the model has already been patched with the reference video fade.
• Solution: Use a fresh model instance or ensure that only one fade patch is applied per model branch.

H3 Reference Video Fade received a MODEL without model options.

• Explanation: The input model lacks the necessary options for the patch to be applied.
• Solution: Check that the model includes the required options and is compatible with the patching process.