ComfyUI model file · CLIP vision encoder

apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors

Apple DFN5B CLIP ViT-H/14 (fp16) · Vision encoder for MMAudio video-to-audio

This is Apple’s DFN5B CLIP ViT-H/14 image encoder in fp16, packaged by Kijai for ComfyUI-MMAudio. MMAudio uses it to read your video frames before generating matching sound. Put it in ComfyUI/models/mmaudio and select it as clip_model in MMAudio FeatureUtilsLoader.

  • MMAudio
  • CLIP ViT-H/14
  • 1.97 GB
  • fp16

Kijai’s repo also has an fp32 copy (3.95 GB). fp16 is enough for MMAudio.

apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors

Type
CLIP vision encoder
Format
Safetensors · fp16
Size
1.97 GB (1,973,509,450 bytes)
SHA256
d8ad903a…8c5d763cb
ComfyUI folder
models/mmaudio/
SHA256 and size from Hugging Face file metadata (Kijai/MMAudio_safetensors), checked by RunComfy on .

The short version

What is apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors?

MMAudio generates audio that matches a video. To know what is on screen, it embeds the frames with a CLIP image encoder: Apple’s DFN5B ViT-H/14, a CLIP model trained on Apple’s filtered DFN-5B dataset. Kijai converted it to a single fp16 safetensors file for his ComfyUI-MMAudio nodes.

Searches often use the lowercase name apple_dfn5b-clip-vit-h-14-384_fp16.safetensors. Kijai’s file uses capitals; on Linux, rename it to match your workflow exactly.

Install

Download and install apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors

Where it goes
ComfyUI/
└─ models/
   ├─ …
   └─ mmaudio/
      └─ apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors
terminal · Linux / macOS
$ cd ComfyUI/models/mmaudio$ wget -O apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors \$   https://huggingface.co/Kijai/MMAudio_safetensors/resolve/main/apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors$ sha256sum apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors# d8ad903a79adc2b29bacfeedabfa3d78b03d36d3b4dcb885c0649fe8c5d763cb

Safetensors files hold tensors only and cannot run code. Still compare the SHA256: a failed download often leaves an HTML error page saved under the model’s filename.

Use

How to load apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors in ComfyUI

MMAudio FeatureUtilsLoader bundles three helper models from models/mmaudio: the audio VAE, Synchformer and this CLIP encoder. Its output feeds MMAudio Sampler with your video frames.

MMAudio FeatureUtilsLoader comes from the ComfyUI-MMAudio custom node pack. Install it with ComfyUI Manager first.

Minimal graph. Click a node to open its reference page.
  • Frame size

    The CLIP encoder resizes frames to 384×384 and reads them at 8 fps.

  • Not a ComfyUI CLIP Vision model

    It does not go in models/clip_vision and Load CLIP Vision will not list it.

Works with

Files MMAudio needs

apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors is one part of the stack. A workflow that reports a missing model usually needs these too. The BigVGAN vocoder downloads itself on first run.

FileRoleFolderSizeDownload
mmaudio_large_44k_v2_fp16.safetensorsMMAudio modelmodels/mmaudio/2.06 GB Get
mmaudio_vae_44k_fp16.safetensorsAudio VAEmodels/mmaudio/611 MB Get
mmaudio_synchformer_fp16.safetensorsSynchformer (audio-video sync)models/mmaudio/475 MB Get

Run it

ComfyUI workflows that can use apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors

We match workflows by the model files they load: this exact file first, then other versions of it, then workflows built for the same use, then other models from the same family.

Uses this exact file

2 workflows

These workflows already load apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors. Open one and run it as is.

Compare

Same file, other names, and alternatives

FileRelationSizeBest for
apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensorsThis page · fp161.97 GBMMAudio in ComfyUI
apple_DFN5B-CLIP-ViT-H-14-384_fp32.safetensorsSame encoder · fp323.95 GBfp32 pipelines

Troubleshoot

Common errors and fixes

Value not in list: clip_model: 'apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors' not in [...]

Why: The workflow asks for this exact filename, but ComfyUI cannot find it in models/mmaudio. Usually the file is missing, sits in a different folder.

Fix: Move the file into ComfyUI/models/mmaudio/, rename it to match the workflow (or pick it again in the dropdown), then refresh the node list or restart ComfyUI.

Missing node type: MMAudioFeatureUtilsLoader

Why: MMAudio FeatureUtilsLoader is not built into ComfyUI. It comes from the ComfyUI-MMAudio custom node pack.

Fix: Install ComfyUI-MMAudio with ComfyUI Manager (or git clone it into ComfyUI/custom_nodes), then restart ComfyUI.

SafetensorError: Error while deserializing header

Why: The download is incomplete, or the browser saved an HTML sign-in or error page under the model’s filename.

Fix: Check that the file is exactly 1,973,509,450 bytes and that its SHA256 matches the value above. Download it again from Hugging Face · Kijai/MMAudio_safetensors if not.

Rather skip the setup?

Run WAN 2.2 Smooth Workflow v5.0 in your browser on a cloud GPU. Nothing to download.

Run MMAudio online

FAQ

apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors FAQ

Which other MMAudio files do I need?

From the same Kijai repo: mmaudio_large_44k_v2_fp16, mmaudio_vae_44k_fp16, mmaudio_synchformer_fp16 and this CLIP encoder, all in models/mmaudio. The BigVGAN vocoder downloads itself on first run.

Where do I put apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors in ComfyUI?

In ComfyUI/models/mmaudio/. Then refresh the node list or restart ComfyUI so MMAudio FeatureUtilsLoader lists the file.

Which ComfyUI node loads apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors?

MMAudio FeatureUtilsLoader. It comes from the ComfyUI-MMAudio custom node pack, so install that first.

Can I use apple_DFN5B-CLIP-ViT-H-14-384_fp16.safetensors commercially?

Be careful. Kijai’s repack is tagged MIT, but the weights come from Apple’s DFN5B release under the Apple Machine Learning Research license, and MMAudio’s own weights are CC BY-NC 4.0. Treat the MMAudio pipeline as non-commercial unless you have other rights.

Sources: Kijai/MMAudio_safetensors · ComfyUI-MMAudio · apple/DFN5B-CLIP-ViT-H-14-378

RunComfy
Copyright 2026 RunComfy. All Rights Reserved.

RunComfy is the premier ComfyUI platform, offering ComfyUI online environment and services, along with ComfyUI workflows featuring stunning visuals. RunComfy also provides AI Models, enabling artists to harness the latest AI tools to create incredible art.