RunComfy is the premier ComfyUI platform, offering ComfyUI online environment and services, along with ComfyUI workflows featuring stunning visuals. RunComfy also provides AI Playground, enabling artists to harness the latest AI tools to create incredible art.
DiffuEraser is a cutting-edge video inpainting solution that seamlessly removes unwanted objects from videos while preserving temporal consistency. Using a powerful diffusion-based inpainting model, DiffuEraser reconstructs missing areas with contextually accurate content. This workflow integrates with Segment Anything 2 (SAM2) for automatic mask generation, eliminating the need for manually created masks.
DiffuEraser utilizes a denoising UNet alongside an auxiliary BrushNet branch, integrating temporal attention to maintain frame consistency. By leveraging prior information, it reduces hallucinations and artifacts, ensuring flawless object removal.
The by Runcomfy Crew automates mask creation using a point-selection interface, enabling users to mark objects for removal without manually creating masks. This significantly streamlines the inpainting workflow.
mask_dilation_iter
for precise maskingcrf
in Video Combine for higher output qualitycheckpoint
: [SD1.5/v1-5-pruned-emaonly.ckpt] - Stable Diffusion base model.lora
: [flux/flux.1-turbo-alpha/diffusion_pytorch_model.safetensors] - LoRA for enhanced inpainting.seed
: [random] - Controls generation variability.num_inference_steps
: [2] - Higher values improve quality.guidance_scale
: [0] - Controls adherence to prior information.video_length
: [10] - Defines processed frames.mask_dilation_iter
: [8] - Expands mask coverage.ref_stride
: [10] - Reference frame stride for temporal consistency.neighbor_length
: [10] - Defines frames used for reference.subvideo_length
: [50] - Max frames processed in a batch.seg_repo
: [briaai/RMBG-2.0] - Background removal model.frame_rate
: [1] - Matches source frame rate.format
: [video/h264-mp4] - Output format.crf
: [19] - Controls video compression quality.subvideo_length
for faster processing.num_inference_steps
to speed up generation.mask_dilation_iter
to improve mask coverage.neighbor_length
for moving object refinements.video_length
and subvideo_length
for longer videos to avoid memory issues.DiffuEraser was created by Xiaowen Li, Haolan Xue, Peiran Ren, and Liefeng Bo from Tongyi Lab, Alibaba Group, with ComfyUI integration by smthemex. Runcomfy Crew enhanced the workflow with automatic mask generation via SAM2. All credit goes to the original authors for their groundbreaking contributions.