The 'SVD Text to Image to Video' workflow in ComfyUI is designed to transform textual descriptions into dynamic video content. This process begins with generating images from text prompts using a combination of nodes like CLIPTextEncode, which encodes the text into a format that the image generation models can interpret. The workflow leverages powerful models such as SVD and Stability to ensure high-quality image outputs. Once the images are created, the workflow transitions into video generation using nodes like SVD_img2vid_Conditioning and VideoLinearCFGGuidance, which guide the transformation of static images into fluid video sequences. This workflow is particularly useful for creators looking to produce engaging video content from simple text inputs without needing extensive video editing skills.
Technically, the workflow is structured to maximize the quality and coherence of both images and videos. The KSampler node plays a crucial role in sampling latent spaces to produce varied and creative outputs, while the VAEDecode node decodes these latent representations into visible images. The CreateVideo node then compiles these images into a seamless video, which can be previewed and saved using PreviewImage and SaveVideo nodes, respectively. This approach is not only efficient but also allows for a high degree of customization and creativity, making it an invaluable tool for artists and marketers alike.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
GET https://comfy.org/workflows/download/4b23697cd68c.jsonFetching workflow JSON…
Run it from Python or TypeScript with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
# Install (beta)
pip install comfy-sdk # Python
npm i @comfyorg/sdk # TypeScript
# Run "SVD Text to Image to Video" (Python)
from comfy_sdk import Comfy
client = Comfy(api_key="comfyui-...")
# This workflow, exported in API format (see note below)
wf = client.workflows.from_file("txt_to_image_to_video_api.json")
wf.set_input("18", "text", "photograph beautiful scenery nature mountains alps river rapids snow sky cumulus clouds") # CLIPTextEncode
job = client.run(wf)
for output in job.get_outputs("24"): # SaveVideo
output.to_file(output.name)The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API). API access requires a Comfy Cloud plan with an API key. SDK docs · Get an API key
FAQ
