MiniMax H3 Face Track Assign / 轨迹绑定角色 (Advanced):
The MiniMaxH3FaceTrackAssignT8Advanced node is designed to enhance the process of associating facial tracks with specific character profiles in video sequences. This advanced node binds each shot-local SAM (Segment Anything Model) track to a reviewed character profile, ensuring that character identification is accurate and consistent across different shots. It leverages CPU-based SFace suggestions to provide one-to-one character associations within each shot, which are validated against similarity and margin thresholds to ensure reliability. The node also supports JSON overrides, allowing users to manually specify authoritative character assignments, such as {"0:0":"Alice"}, which take precedence over automated suggestions. This feature is particularly beneficial for projects requiring precise character tracking and identification, as it allows for manual intervention and customization to meet specific artistic or narrative needs.
MiniMax H3 Face Track Assign / 轨迹绑定角色 (Advanced) Input Parameters:
frames
This parameter represents the sequence of video frames that the node will process. It is crucial for defining the scope of the analysis, as the node will bind character profiles to the facial tracks detected within these frames. There are no specific minimum or maximum values, but the frames should be part of a coherent video sequence for optimal results.
track_plan
The track plan is a structured input that outlines the expected movement and presence of faces across the frames. It guides the node in identifying and associating facial tracks with character profiles. This input is essential for ensuring that the node can accurately follow and assign identities to faces throughout the video.
face_cast
This parameter provides a predefined list of potential character profiles that the node can assign to detected facial tracks. It acts as a reference for the node to match detected faces against known characters, facilitating accurate and consistent character identification.
identity_mode
The identity mode determines the method used for suggesting character identities. The default option is "sface_cpu_suggest", which utilizes CPU-based SFace suggestions to propose character matches. This mode is designed to balance performance and accuracy, making it suitable for most use cases.
manual_assignments_json
This parameter allows users to input a JSON string that specifies manual character assignments. These assignments override automated suggestions, providing a way to enforce specific character identities when necessary. The JSON format should be structured as key-value pairs, such as {"0:0":"Alice"}.
minimum_similarity
This parameter sets the threshold for the minimum similarity score required for a character suggestion to be considered valid. A higher value increases the strictness of the matching process, ensuring that only highly similar faces are assigned to character profiles. The default value is 0.40.
minimum_margin
The minimum margin defines the acceptable difference between the top similarity score and the next highest score. This ensures that character assignments are made with confidence, reducing the likelihood of incorrect matches. The default value is 0.05.
identity_samples_per_track
This parameter specifies the number of identity samples to be taken per track. It influences the robustness of the identity assignment process, with more samples providing a more reliable basis for character identification. The default value is 3.
strict_identity
When set to True, this parameter enforces strict identity matching, ensuring that only the most confident character assignments are accepted. This setting is ideal for projects where accuracy is paramount.
preview_stride
The preview stride determines the interval at which frames are sampled for preview purposes. A larger stride reduces the number of frames processed, which can speed up the preview process but may miss some details. The default value is 8.
MiniMax H3 Face Track Assign / 轨迹绑定角色 (Advanced) Output Parameters:
colored_shot_local_ids
This output provides a visual representation of the character assignments, with each character track being assigned a unique color. This makes it easy to review and verify the accuracy of the character bindings across the video sequence.
json_review
The JSON review output contains the character assignments in a structured format, allowing for easy inspection and modification. This output is particularly useful for making manual adjustments or for integrating the results into other workflows.
MiniMax H3 Face Track Assign / 轨迹绑定角色 (Advanced) Usage Tips:
- Ensure that the frames input covers the entire sequence you wish to analyze for consistent character tracking.
- Use the manual_assignments_json parameter to enforce specific character identities when automated suggestions are insufficient.
- Adjust the minimum_similarity and minimum_margin parameters to fine-tune the balance between accuracy and flexibility in character assignments.
MiniMax H3 Face Track Assign / 轨迹绑定角色 (Advanced) Common Errors and Solutions:
"SAM3.1 detected no people in shot <shot_id>"
- Explanation: This error occurs when the SAM model fails to detect any faces in the specified shot.
- Solution: Verify that the frames input is correct and that the video quality is sufficient for face detection. Consider adjusting the detection threshold or using a different model if the issue persists.
"SAM3.1 returned only empty tracks in shot <shot_id>"
- Explanation: This error indicates that the SAM model detected tracks, but they were empty, meaning no active frames were found.
- Solution: Check the track_plan input for accuracy and ensure that the frames contain visible faces. Adjust the detect_interval or maximum_people parameters to improve detection results.