This ComfyUI workflow turns a single still image into an audio‑reactive video using the LTX‑Video 2.3 model enhanced with the Audio‑Reactive LoRA. You provide one image via LoadImage and an audio track via LoadAudio; a GeminiNode in the Create Audio‑Reactive LoRA Prompt group helps craft a clean, descriptive text prompt from your idea (and optionally your image context). That prompt, together with the image and audio, flows into the LTX 2.3 video generator node (dacae91a-7342-43be-a654-227b303c33bc), where the Audio‑Reactive LoRA modulates motion and visual rhythm in response to the soundtrack. You can preview output with PreviewAny and export the final result with SaveVideo.
Technically, the workflow applies the Audio‑Reactive LoRA from https://huggingface.co/100percentrobot/LTX-2.3-Audio-Reactive-LORA at inference time on top of LTX 2.3. The LoRA strength parameter controls how strongly the audio‑driven behavior influences the video: use 1.0–2.0 overall, with 1.4+ for more pronounced reactivity. This design is practical for fast, beat‑aware animations of posters, album art, and social posts: you focus on a concise prompt and good source media, while the LTX node handles frame synthesis and timing, and SaveVideo writes a ready‑to‑share clip.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
GET https://comfy.org/workflows/download/5cd417e793b8.jsonFetching workflow JSON…
Run it from Python or TypeScript with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
# Install (beta)
pip install comfy-sdk # Python
npm i @comfyorg/sdk # TypeScript
# Run this workflow (Python)
from comfy_sdk import Comfy
client = Comfy(api_key="comfyui-...")
wf = client.workflows.from_file("workflow_api.json")
job = client.run(wf)
for output in job.get_outputs("<output-node-id>"):
output.to_file(output.name)The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API). API access requires a Comfy Cloud plan with an API key. SDK docs · Get an API key
FAQ
