Save 4 hours! We auto-setup your workflow! Free!

Drop your workflow.json — we handle every dependency, custom node, and model. Just open the link and run.

Auto-Setup Workflow Json (Free) Now!
ComfyUI > Nodes > ComfyUI-llamacpp-helper

ComfyUI Extension: ComfyUI-llamacpp-helper

Repo Name

ComfyUI-llamacpp-helper

Author
bbaudio-2025 (Account age: 0 days)
Nodes
View all nodes(1)
Latest Updated
2026-11-03
Github Stars
0.0K

How to Install ComfyUI-llamacpp-helper

Install this extension via the ComfyUI Manager by searching for ComfyUI-llamacpp-helper
  • 1. Click the Manager button in the main menu
  • 2. Select Custom Nodes Manager button
  • 3. Enter ComfyUI-llamacpp-helper in the search bar
After installation, click the Restart button to restart ComfyUI. Then, manually refresh your browser to clear the cache and access the updated list of nodes.

Visit ComfyUI Online for ready-to-use ComfyUI environment

  • Free trial available
  • 16GB VRAM to 80GB VRAM GPU machines
  • 400+ preloaded models/nodes
  • Freedom to upload custom models/nodes
  • 200+ ready-to-run workflows
  • 100% private workspace with up to 200GB storage
  • Dedicated Support

Run ComfyUI Online

ComfyUI-llamacpp-helper Description

ComfyUI-llamacpp-helper adds local llama.cpp models to ComfyUI workflows for text generation and supported image, audio, or video input. It runs a separate server that can stop after use to free memory.

ComfyUI-llamacpp-helper Introduction

ComfyUI-llamacpp-helper lets you use a local llama.cpp language model inside a ComfyUI workflow. You can ask the model to write or revise text, and, with a compatible multimodal model, provide an image, audio, or video as input.

The extension runs llama-server as a separate process rather than loading the language model into ComfyUI. This makes it useful when you want to add language-model steps to a creative workflow without keeping the model in memory after generation. By default, the extension starts the server when needed and stops it when generation finishes, releasing the memory used by that server. It also does not require extra Python packages in ComfyUI, such as llama_cpp_python.

How ComfyUI-llamacpp-helper Works

Think of ComfyUI as your workspace and llama-server as a separate assistant. ComfyUI sends your prompt and any connected inputs to the server through a local HTTP request. The server runs the model and sends the response back to your workflow. ComfyUI itself does not load the language model.

A typical workflow has two main steps:

  1. Choose the model: Use Load llama.cpp Model to point to the llama-server executable and a .gguf model file.
  2. Generate a response: Connect that node to LLM (llama.cpp server), enter a prompt, and queue the workflow. The generation node returns text and reasoning outputs.

With auto_start enabled, the server launches when it is first needed. With release_after_use enabled, it stops after generation. If you queue the workflow again, auto_start can launch it again. This default behavior helps avoid leaving the server’s GPU and system memory occupied between runs.

For example, you could enter a text request asking for variations of a scene description. If your chosen model supports image input and you provide its matching multimodal projector, you could also connect an image and ask about what it contains.

ComfyUI-llamacpp-helper Features

  • Model and server controls — Load llama.cpp Model: Select the server_exe executable and model_path .gguf file. You can also set the server’s host and port, context_size, and n_gpu_layers, which controls GPU-layer use. For a compatible multimodal model, mmproj_path points to its matching .gguf projector.
  • Text generation — LLM (llama.cpp server): Write a prompt and, optionally, a system_prompt for instructions that guide the response. The node also accepts history for prior conversation context and provides separate text and reasoning outputs.
  • Response controls: temperature, top_p, and top_k adjust how the model samples its response; changing them can make responses feel more varied or more constrained. max_tokens limits response length, repeat_penalty affects repetition, and seed gives you another way to control sampling. Results still depend on the model and prompt you choose.
  • Image, audio, and video inputs: Connect supported media to the generation node when you want the model to respond to more than text. These inputs require both a model that supports the relevant media and a matching mmproj file. Connecting media to a text-only model is not enough to give it multimodal abilities.
  • Skills — Load llama.cpp Skill: Load a skill directory containing SKILL.md and text or media files. The extension injects the skill as a system prompt, letting you provide reusable guidance to the model.
  • Server lifecycle controls: auto_start launches the server when needed; release_after_use stops it after generation and is enabled by default. If you need to stop a server yourself, use Stop llama.cpp server for the specified port.

ComfyUI-llamacpp-helper Models

The extension does not include a fixed list of models. You choose a local GGUF model supported by llama-server. A text-capable model can handle text prompts; image, audio, or video input additionally requires a model with the corresponding multimodal support and a matching GGUF mmproj file.

Your model choice affects what the workflow can accept and the responses it produces. For instance, choosing a text-only model is suitable for writing a description, while asking a model about a connected image requires compatible multimodal files. llama-server cannot load a safetensors model directly.

Model and projector dropdowns look for .gguf files in the directories configured in the extension’s config.json. Its default paths include ComfyUI’s models/text_encoders and models/LLM directories, along with an example path. If your files live elsewhere, update model_roots and mmproj_roots to match their actual directories. You can also paste a full file path if a dropdown has no matching entry.

Troubleshooting ComfyUI-llamacpp-helper

My model does not appear in the dropdown. What should I check?

  1. Confirm that the model file ends in .gguf.
  2. Open the extension’s config.json and check that model_roots points to the directory containing the file.
  3. If you are looking for a projector, check mmproj_roots instead.
  4. If the file still does not appear, paste its full path into the relevant field.

The workflow cannot use my model. Can I select a safetensors file?

No. Select a GGUF model instead: llama-server cannot load safetensors directly. Also check that server_exe points to your llama.cpp server executable. The author links to llama.cpp releases as a source for llama.cpp.

Why is my image, audio, or video input not working?

Check that your chosen model supports that type of input, then provide its matching .gguf file in mmproj_path. Both are needed for multimodal use; the extension cannot add media support to an incompatible model.

Why does the server start again each time I run the workflow?

That is expected with the default lifecycle settings. release_after_use stops the server after generation to free its memory, and auto_start launches it again for the next run. You can change these settings in the generation node if you do not want that behavior.

How do I stop a server manually?

Use Stop llama.cpp server and specify the port used by the server you want to stop.

Why is my skill not available?

Check that skill_roots in config.json points to the directory where your skill folders are stored, and that the skill directory contains SKILL.md.

Learn More about ComfyUI-llamacpp-helper

  • llama.cpp — learn about the local model server that this extension uses.
  • llama.cpp releases — find the llama.cpp downloads referenced by the author.

ComfyUI-llamacpp-helper Related Nodes

RunComfy
Copyright 2025 RunComfy. All Rights Reserved.

RunComfy is the premier ComfyUI platform, offering ComfyUI online environment and services, along with ComfyUI workflows featuring stunning visuals. RunComfy also provides AI Models, enabling artists to harness the latest AI tools to create incredible art.

ComfyUI-llamacpp-helper detailed guide | ComfyUI