The Noise Injected VideoGen workflow is designed to transform static images into dynamic videos by leveraging noise patterns and AI-generated prompts. This workflow begins with a static image and a mask video that defines the area of noise injection. The process utilizes the 'VHS_LoadVideo' node to load a noise video, which is then combined with the static image using 'VHS_VideoCombine'. The 'AILab_QwenVL' node plays a crucial role in generating AI-driven prompts that guide the transformation process, ensuring that the resulting video is both coherent and visually engaging. The workflow employs 'comfyui-animatediff-evolved' and 'comfyui-frame-interpolation' nodes to enhance the fluidity and realism of the video transitions, making it an excellent tool for creating professional-grade video content from simple images.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
GET https://comfy.org/workflows/download/a50ab9e1df59.jsonFetching workflow JSON…
Run it from Python or TypeScript with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
# Install (beta)
pip install comfy-sdk # Python
npm i @comfyorg/sdk # TypeScript
# Run "Noise Injected VideoGen" (Python)
from comfy_sdk import Comfy
client = Comfy(api_key="comfyui-...")
# This workflow, exported in API format (see note below)
wf = client.workflows.from_file("templates_mjm_Injected_api.json")
asset = client.assets.from_file("input.png")
wf.set_input("8", "image", asset) # LoadImage
wf.set_input("173", "text", "watermark, face, text, signature, blurry") # CLIPTextEncode
job = client.run(wf)
for output in job.get_outputs("157"): # VHS_VideoCombine
output.to_file(output.name)The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API). API access requires a Comfy Cloud plan with an API key. SDK docs · Get an API key
FAQ
