ComfyUI Extension: ComfyUI_MusicTools

ComfyUI_MusicTools Introduction

ComfyUI_MusicTools is a powerful extension designed to enhance your audio processing capabilities within the ComfyUI environment. This extension provides a suite of professional-grade audio tools that allow you to perform tasks such as audio enhancement, stem separation, vocal processing, and AI-powered denoising. Whether you're a musician, sound engineer, or content creator working with AI-generated audio, ComfyUI_MusicTools offers the tools you need to refine and perfect your sound.

How ComfyUI_MusicTools Works

ComfyUI_MusicTools operates within the ComfyUI framework, utilizing a node-based system to process audio. This means you can visually connect different audio processing nodes to create a custom audio processing pipeline. Each node represents a specific audio processing task, such as noise reduction or vocal enhancement. By connecting these nodes, you can create complex audio processing workflows without needing to write any code. This approach makes it accessible for users who prefer a visual interface over traditional coding methods.

ComfyUI_MusicTools Features

Vocal Naturalizer

The Vocal Naturalizer is a standout feature that removes robotic and auto-tune artifacts from AI-generated vocals. It achieves this through:

• Pitch Humanization: Adds natural vibrato and pitch variation.
• Formant Variation: Humanizes the timbre and vocal character.
• Artifact Removal: Eliminates metallic digital artifacts.
• Quantization Masking: Smooths pitch steps with shaped noise.
• Transition Smoothing: Provides natural glides between notes.

Master Audio Enhancement Node

This node offers a complete mastering chain, including:

• Noise Reduction: Options for hiss-only or full denoise.
• Tonal Shaping: 3-band parametric EQ and clarity enhancement.
• Dynamics Processing: Multiband compression and true-peak limiting.
• Vocal Processing: De-esser, breath smoother, and vocal reverb.
• Loudness Standards: LUFS normalization for various platforms.

Stem Separation & Mixing

Allows for advanced stem processing:

• 4-Stem Separation: Separates audio into vocals, drums, bass, and other.
• Individual Processing: Apply effects to each stem independently.
• Flexible Recombination: Custom volume control per stem.

ComfyUI_MusicTools Models

ComfyUI_MusicTools utilizes various models for different audio processing tasks. For stem separation, it uses models like Demucs and Spleeter, which are optimized for extracting individual audio components such as vocals and instruments. The AI enhancement features leverage models like SpeechBrain's MetricGAN+ for neural audio enhancement, providing clarity and reducing noise in audio tracks.

What's New with ComfyUI_MusicTools

The latest version of ComfyUI_MusicTools introduces the Vocal Naturalizer, a feature specifically designed to humanize AI-generated vocals by removing robotic artifacts. This update significantly enhances the quality of AI vocals, making them sound more natural and human-like. Additionally, performance optimizations have been made across all processing functions, resulting in faster processing times.

Troubleshooting ComfyUI_MusicTools

Common Issues and Solutions

• Issue: "No module named 'noisereduce'"
• Solution: Ensure all dependencies are installed by running pip install -r requirements.txt.
• Issue: Vocal Naturalizer not working
• Solution: Check that the vocal_enhance option is enabled and the naturalize_vocal parameter is set appropriately.
• Issue: Stem separation fails
• Solution: Install the required models by running pip install spleeter demucs.
• Issue: Audio too quiet after processing
• Solution: Increase the lufs_target parameter for a louder output.

Learn More about ComfyUI_MusicTools

To further explore the capabilities of ComfyUI_MusicTools, you can access additional resources such as tutorials and community forums. The ComfyUI website offers a wealth of information, including example workflows and detailed documentation. Engaging with the community through forums and discussions can also provide valuable insights and support as you work with this extension.