The 'Capybara: Image to Video' workflow is designed to transform a static image into a dynamic video based on user-provided text instructions. This workflow leverages the Capybara model, which excels in maintaining the structure and temporal coherence of the original image while introducing the specified changes. Technically, the process begins with the 'LoadImage' node, which imports the initial image. The core transformation is handled by the Capybara model node (4f4ddf39-1508-4d34-a35c-ff10e6ce995b), which interprets the text instructions to edit the image progressively across frames, creating a seamless video output. Finally, the 'SaveVideo' node compiles these frames into a coherent video file.
This workflow is particularly useful for content creators and digital artists who wish to animate static images with specific thematic or stylistic changes. By preserving the original image's structure, the workflow ensures that the resulting video remains true to the source material, while the temporal coherence feature prevents jarring transitions between frames. The Capybara model's ability to handle various resolutions and aspect ratios, as detailed in the resolution configuration, adds versatility to this tool, making it suitable for different platforms and display requirements.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
GET https://comfy.org/workflows/download/1d69cf9d1761.jsonFetching workflow JSON…
Run it from Python or TypeScript with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
# Install (beta)
pip install comfy-sdk # Python
npm i @comfyorg/sdk # TypeScript
# Run "Capybara: Image to Video" (Python)
from comfy_sdk import Comfy
client = Comfy(api_key="comfyui-...")
# This workflow, exported in API format (see note below)
wf = client.workflows.from_file("video_capybara_v0_1_image_to_video_api.json")
asset = client.assets.from_file("input.png")
wf.set_input("126", "image", asset) # LoadImage
job = client.run(wf)
for output in job.get_outputs("114"): # SaveVideo
output.to_file(output.name)The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API). API access requires a Comfy Cloud plan with an API key. SDK docs · Get an API key
FAQ
