OpenKatana Introduction
OpenKatana is an independent, open-source editing engine that lets an AI agent build and revise videos using your photos, footage, music, and creative direction. It brings cuts, transitions, animation, typography, effects, audio, and 3D scenes into one editable project.
Instead of asking a single video-generation model to produce a finished clip, you can ask your agent to work with real editing tools. OpenKatana carries out those editing instructions and renders the result on your machine. You can then review the project in Studio, its browser-based editor, and continue refining it.
For AI artists, this makes OpenKatana useful when you want to:
- Turn generated images or existing photos into an animated visual story.
- Combine AI-generated clips with your own footage.
- Cut a sequence to music and add transitions, sound effects, and titles.
- Create motion graphics or a code-authored 3D product film.
- Study the rhythm and visual treatment of a reference edit.
- Keep the underlying edit available for changes instead of receiving only a finished video. Version described here: 0.1.3. OpenKatana provides 75 CLI/MCP tools and a ComfyUI integration with 88 nodes, including editing tools and project, media, and background-job helpers.
The standard workflow runs locally and does not require an OpenKatana account. Generative models are optional and separate from the editing engine.
OpenKatana is inspired by Higgsfield’s Katana but is independent of Higgsfield AI. It contains no Higgsfield code and does not connect to Higgsfield services.
How OpenKatana Works
Think of OpenKatana as a workshop with three roles:
- You are the creative director: you decide the mood, story, pacing, and final look.
- Your AI agent is the editor: it translates your instructions into shots, timing, effects, and tool calls.
- OpenKatana is the editing and rendering engine: it applies those decisions and produces previews and exports.
1. Start with your idea and media
Bring photos, video clips, or music, and describe what you want to make. You can also request an original scene built with code rather than generated by a video model.
For example, your creative brief might be:
“Make a short product film from these images. Start slowly, build toward the music’s strongest moment, and finish with a clean title.”
This is an example of direction you can give an agent, not a built-in preset.
2. The agent builds an editable timeline
A timeline is the plan for your video: which image appears, when a clip starts, how long a title stays visible, and where effects or sound changes occur.
OpenKatana stores this plan in project files, including a text-based timeline format called JSON. You do not need to write that format yourself when an agent or ComfyUI App is handling the work.
The important benefit is that individual creative choices remain editable. Changing a title or shortening a shot does not require starting the entire project again.
3. OpenKatana renders the frames and assembles the video
The rendering engine draws frames using browser-based graphics technologies, including Canvas 2D and WebGL. FFmpeg then encodes the finished video.
In simpler terms, OpenKatana first creates the pictures that make up the animation, then combines them into a playable video with audio.
4. You review and refine
Preview frames, watch motion, open the project in Studio, and ask for changes. You can move between agent-led editing and hands-on review without creating a separate project.
OpenKatana workflow: bring your idea, let your agent author the edit, render, and review
One project, four ways to work
| Interface | What it means for you |
|---|---|
| Studio | A browser-based editor for reviewing and refining the project. |
| ComfyUI Apps | Saved workflows that let you use OpenKatana through ComfyUI, including without an agent. |
| CLI | A command-line interface your agent can use to operate local editing tools. |
| MCP | An optional connection method that gives a compatible agent access to OpenKatana’s tools. |
All four interfaces use the same project files. Revision checks help detect conflicting edits when different interfaces work on the same project.
OpenKatana Features
Editing, pacing, and audio
OpenKatana supports cuts, transitions, speed ramps, camera moves, beat analysis, audio mixing, and sound effects.
These tools help you control how a sequence feels:
- Shorter shots can make an edit feel more energetic.
- Longer shots can give an image, performance, or product more time to register.
- Speed ramps change playback speed within a shot.
- Beat analysis provides information that can guide cuts and motion around the music.
- Audio mixing lets you combine music and other sounds in the same project. Your agent supplies the creative decisions; OpenKatana executes them. Beat analysis, for example, is a tool for shaping an edit—not a guarantee that every cut will automatically land where you want it.
Reference-edit analysis
The analyze_reference tool examines a reference at 60 frames per second. It measures details such as:
- Cuts versus brief flashes.
- The timing and cadence of image changes.
- The visual appearance of individual shots.
- Texture movement.
- The shape of transitions. It turns those observations into timeline settings. This can help you communicate a style more clearly than a broad request such as “make it cinematic.”
Reference analysis measures editing characteristics; it should not be treated as a promise of an exact recreation.
Animated typography and motion graphics
OpenKatana includes animated lettering, multilingual text shaping, responsive layouts, masks, and reusable effects.
You can use these capabilities for titles, product labels, graphic overlays, and other text-led sequences. Timing matters as much as styling: a quick title entrance can reinforce an energetic cut, while a slower reveal can suit a quieter scene.
Effects and compositing
Effects can change the appearance of a layer or create visual elements of their own. OpenKatana supports animation through keyframes, which describe a setting at different moments.
For example, you can start an effect gently, increase its strength during a transition, then return it to normal.
| Effect group | Available effects | Creative uses |
|---|---|---|
| Displacement | Turbulent Displace, Displacement Map | Warped surfaces and map-driven treatments such as heat haze, glass, or water. |
| Distort | Wave Warp, Ripple, Shockwave, Twirl, Bulge, Polar Coordinates, Kaleidoscope, Mirror | Rippling images, impact accents, swirling transitions, and repeated geometric patterns. |
| Light | Deep Glow, Lens Flare, Light Rays, Light Sweep | Luminous highlights, light streaks, and moving reflections. |
| Time | Echo, Time Displacement, Posterize Time, frame blending | Motion trails, time-offset imagery, stepped animation, and blended frames. |
| Blur & Sharpen | Gaussian Blur, Directional Blur, Radial Blur, Camera Lens Blur, Unsharp Mask, Channel Blur, Tilt-Shift | Softness, directional movement, selective focus, or sharper detail. |
| Stylize | RGB Split, Motion Tile, Find Edges, Emboss, Mosaic, Scatter | Color separation, repeated imagery, graphic outlines, textured surfaces, and fragmented looks. |
| Generate | Fractal Noise, Advanced Lightning, Radio Waves, Cell Pattern, Gradient Ramp, 4-Color Gradient, Grid | Procedural textures, energy effects, backgrounds, and graphic patterns. |
Effects support keyframes, easing, and antialiasing:
- Keyframes set values at particular times.
- Easing controls whether a change feels smooth, abrupt, accelerating, or slowing down.
- Antialiasing helps smooth jagged edges.
For example, this timeline fragment animates a twirl angle from
0to240, with a radius setting of0.45:
"fx": {
"local_twirl": {
"angle": [[0, 0, "ease"], [1, 240]],
"radius": 0.45
}
}
You can ask your agent to create these settings instead of editing JSON yourself. A smaller angle gives a gentler twist; a larger angle creates a more pronounced spiral.
To explore an effect before using it in a larger edit, use the OpenKatana · Preview effect node in ComfyUI or ask your agent to call preview_effect.
See the effects gallery, effects playbook, and timeline documentation.
3D scenes and product films
OpenKatana can work with code-authored WebGL scenes containing materials, lights, camera paths, rigs, and morphs. An optional Blender rendering workflow is also available.
This allows you to build a film around an original 3D scene rather than relying on a video-generation model for every shot.
Studio is not a full graphical 3D scene editor. The 3D workflow is code-authored, with OpenKatana assembling and finishing the resulting film.
Learn more in the 3D guide, WebGL guide, and Blender workflow documentation.
Previewing and finishing
OpenKatana supports frame previews, motion checks, HDR workflows, and video export.
For a more manageable review process, you can ask your agent to check a representative frame or short motion section before rendering the full edit. This makes it easier to judge typography, effect strength, and timing while the project is still being refined.
See the HDR documentation for HDR-specific workflows.
OpenKatana capabilities: 3D and morphs, typography and graphics, editing and sound
OpenKatana in ComfyUI
OpenKatana includes seven saved Apps:
| App | Purpose |
|---|---|
| 00 Full workflow | Brings the workflow together in one graph, including media, editing, rendering, Studio, a 3D starter, and tool access. |
| Open Studio | Opens the project in Studio. |
| All tools | Provides access to OpenKatana’s tools. |
| Make a 3D scene | Offers a starting point for a 3D workflow. |
| Background job | Provides a workflow for background jobs. |
| Video to edit | Provides a route from video media into an editable project. |
| Preview an effect | Lets you try an effect before using it in an edit. |
For your first session, start with Apps → OpenKatana → 00 Full workflow. Run it in App mode; Studio opens in its own window.
You can also connect a local model’s image frames or video output through:
Import media → Make edit → Render to video
Then open the same project in Studio to refine it.
The ComfyUI Apps route runs locally, with cloud and paid generation disabled. Authorized model calls are available separately through the CLI/agent workflow.
OpenKatana running in ComfyUI, from the Full workflow App to Studio
Watch the demonstration video or consult the ComfyUI Apps documentation for workflow details.
OpenKatana Models
OpenKatana is an editing engine, not a single generative model. You can edit existing media, animate text, apply effects, and create code-authored scenes without downloading generative model weights.
Optional model workflows extend the engine:
| Workflow | When it is useful | Important distinction |
|---|---|---|
| Local open-weights workflows | When you want optional model processing through local ComfyUI workflows. | Models are installed separately and have their own hardware requirements and licenses. |
| Authorized API models | When you choose to use a supported external model service through the CLI/agent workflow. | Service access, authorization, charges, and data handling are separate from local editing. |
| Restoration and generation adapters | When a project needs model-based restoration or newly generated media. | These depend on separately installed or authorized models. |
The project also references an edit of a bundled LTX-2.5 clip in its automated tests. That test edits an existing clip; it does not run the model or require ComfyUI.
For supported model workflows and their requirements, use the model documentation. There is no basis here for treating different models as interchangeable editing presets.
Before asking an agent to use optional services, a useful instruction is:
“Ask before downloading models, spending credits, uploading files, or publishing anything.”
What’s New with OpenKatana
Version 0.1.3: six new effect packs
Version 0.1.3 adds six packs covering 37 effects:
- Distort.
- Light.
- Time.
- Blur & Sharpen.
- Stylize.
- Generate. These join the existing Turbulent Displace and Displacement Map effects.
For artists, the update expands the range of looks you can build directly in the editable timeline—from restrained glow and blur to kaleidoscopic transitions, echo trails, procedural lightning, and animated gradients.
The effects can be previewed through the ComfyUI node or preview_effect, and the effects playbook provides a recipe for each.
OpenKatana effect examples, including Twirl, Kaleidoscope, Lens Flare, Echo, and Advanced Lightning
For the documented release history, see the release notes and v0.1.3 release page.
OpenKatana Examples
Anime edit: cuts, effects, motion, and music
Finished Koji anime edit made with OpenKatana
Watch the anime edit with sound.
This example demonstrates OpenKatana editing existing animation into a finished sequence.
Source animation: “Koji” by Ammonite & Zean, licensed CC BY. Music was made with Suno (https://suno.com); the edit was made with OpenKatana.
MOTIF: a code-authored product film
Eight-second preview of MOTIF, a product film made with OpenKatana and Blender
Watch or download MOTIF in 1080p at 60 fps, with sound.
MOTIF is a 24-second film featuring procedural 3D objects, choreographed cameras, animated displays, typography, and an original soundtrack.
This export used the optional Blender workflow, with OpenKatana assembling and finishing the film. No video-generation model was used.
The GIF is a reduced-resolution, reduced-frame-rate preview. Use the MP4 to judge the original motion and audio. See the artwork and film credits.
Troubleshooting OpenKatana
Studio does not open from ComfyUI
- Start with Apps → OpenKatana → 00 Full workflow.
- Run the workflow in App mode.
- Check for Studio opening in a separate window.
- If it still does not open, ask your agent to check the required tools and editor configuration against the ComfyUI Apps documentation. The ComfyUI demonstration shows the expected transition from the App to Studio.
A local model’s output is not becoming an edit
- Check that its image frames or video output are connected to Import media.
- Follow the chain Import media → Make edit → Render to video.
- Open the same project in Studio to inspect the result.
- If the model itself is failing, consult the model documentation; model processing and timeline editing are separate stages.
An effect looks too strong or does not behave as expected
- Test it separately with Preview an effect or
preview_effect. - Check its recipe in the effects playbook.
- Ask your agent to review its strength, radius, timing, and keyframes, as applicable.
- Review a short motion preview rather than relying only on a still frame. A still frame can show the appearance of an effect, but it cannot fully reveal time-based behavior such as echo trails or frame blending.
An agent-created timeline is rejected
OpenKatana validates timelines against strict rules, including rejecting unknown fields.
- Ask your agent to read the validation error.
- Have it compare the proposed settings with the timeline documentation.
- Correct unsupported fields or values and validate again. Consult the validation guide rather than repeatedly guessing parameter names.
Rendering or exporting fails
- Check whether the failure occurs during frame rendering or final video encoding.
- Ask your agent to verify the required browser and FFmpeg availability.
- If the project uses Blender or models, check those optional components separately.
- Compare the attempted workflow with the capability matrix and known limits. A working standard edit does not establish that every optional 3D or model workflow is ready.
Frequently asked questions
Do I need a dedicated GPU? Not for the standard editing and rendering workflow. Generative models and 3D workloads have their own requirements.
Can I use OpenKatana without an AI agent? Yes. The ComfyUI Apps provide a route without an agent.
Which agents are tested? Claude Code and Codex. An agent needs to be able to read local files and run commands.
Is OpenKatana free? It is free to use locally. Your agent provider may charge for its service, and optional paid model services have separate costs.
Does local editing upload my media? The standard editing workflow runs on your machine. Optional external model services are a separate choice; review their data handling before authorizing uploads.
Can I return to an edit after exporting? The underlying project remains editable. Exporting a video does not replace the project with only a flattened clip.
Is Studio a complete graphical 3D editor? No. OpenKatana supports code-authored 3D workflows, but Studio is not a full graphical 3D scene editor.
Which operating systems are covered by testing? The project’s automated tests cover Windows, macOS on Apple silicon, and Linux. See the completed test runs for the revision you use.
Learn More about OpenKatana
For your first creative project
- Demonstration video — see the workflow in action.
- Studio guide — learn about the browser editor.
- ComfyUI Apps documentation — understand the available App workflows.
- Agent skill — guidance your agent can read when working on a video.
- Agent guide — understand agent access and the optional MCP interface.
For effects, motion, and visual design
- Effects gallery — browse visual examples.
- Effects playbook — find effect recipes.
- Compositions — explore composition workflows.
- Editor tools — learn about editing operations.
- All 75 tools — see the complete tool reference.
For advanced projects and limitations
- 3D scenes, WebGL, and Blender workflows.
- HDR workflows.
- Optional models.
- Capability matrix and known limits.
- Project repository and Comfy Registry listing. The capability and workflow illustrations in this README are AI-generated explanatory images. The linked films and effects reel show actual rendered output.
OpenKatana License and Media Rights
OpenKatana is released under the Apache-2.0 license.
Bundled components retain their own licenses and notices. External software, model weights, footage, music, fonts, and other media may have separate terms. OpenKatana’s license does not grant rights to those materials or guarantee that a finished project is cleared for every use.
Before publishing, review the rights for the assets and services you used. See the licensing guide, NOTICE, and third-party notices.
