This ComfyUI workflow turns a single reference image and an audio track into a synchronized video using the Wan 2.2 S2V (sound-to-video) model. It loads the Wan backbone with UNETLoader, CLIPLoader, and VAELoader, and sets the correct schedule via ModelSamplingSD3. Your text prompt is encoded by CLIPTextEncode, while the audio is processed by AudioEncoderLoader and AudioEncoderEncode. These signals, together with the image from LoadImage, drive WanSoundImageToVideo to synthesize motion that follows the rhythm and phrasing of the audio. The KSampler controls steps, CFG, and seed; VAEDecode converts latents to frames; and CreateVideo assembles the final clip.
Two engineering details make the workflow practical for production: a first-frame stabilization and scalable length. The Fix overbaked first frame group uses LatentCut and LatentConcat to duplicate the initial latent frame before decoding, then discards the first decoded frame to avoid the common VAE “overbaked” look on frame 0. For long clips, the Video S2V Extend subgraphs let you chain segments in chunks (77 frames by default) using LatentCut/LatentConcat, so you can build minute-level videos without blowing up VRAM. The workflow also supports a lightning path: with a Wan 2.2 lightning LoRA you can sample in 4 steps (recommended CFG ~1.0). If you prefer quality and stability, use the standard path at ~20 steps (CFG ~6.0).
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
GET https://comfy.org/workflows/download/02b3722db38c.jsonFetching workflow JSON…
Run it from Python or TypeScript with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
# Install (beta)
pip install comfy-sdk # Python
npm i @comfyorg/sdk # TypeScript
# Run "Wan2.2-S2V Audio-Driven Video Generation" (Python)
from comfy_sdk import Comfy
client = Comfy(api_key="comfyui-...")
# This workflow, exported in API format (see note below)
wf = client.workflows.from_file("video_wan2_2_14B_s2v_api.json")
asset = client.assets.from_file("input.png")
wf.set_input("52", "image", asset) # LoadImage
wf.set_input("6", "text", "your prompt here") # CLIPTextEncode
job = client.run(wf)
for output in job.get_outputs("113"): # SaveVideo
output.to_file(output.name)The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API). API access requires a Comfy Cloud plan with an API key. SDK docs · Get an API key
FAQ
