This ComfyUI tutorial workflow turns a single piece of concept art into a short, stop‑motion‑style video. It uses LoadImage to bring your reference artwork into the graph, feeds it into ByteDance2ReferenceNode to synthesize motion while preserving the look of the original design, and then encodes the result with SaveVideo. The ByteDance2ReferenceNode is the engine of the pipeline: it performs reference‑to‑video generation by conditioning on your image so the character, style, and palette remain consistent across frames while introducing controlled movement.
Technically, the workflow keeps things simple and focused on iteration. You supply a clean, well‑framed reference image; ByteDance2ReferenceNode generates a sequence of frames guided by the reference, and SaveVideo writes those frames to an MP4 at a frame rate you choose. To emphasize a stop‑motion aesthetic, you typically use a lower FPS (for example, 8–12) and modest motion magnitude so changes appear stepwise and tactile. Because the setup is lightweight (LoadImage → ByteDance2ReferenceNode → SaveVideo), it’s easy to re‑run with different reference images or parameter tweaks to dial in timing, motion intensity, and framing.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
GET https://comfy.org/workflows/download/70e6b211c5ff.jsonFetching workflow JSON…
Run it from Python or TypeScript with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
# Install (beta)
pip install comfy-sdk # Python
npm i @comfyorg/sdk # TypeScript
# Run this workflow (Python)
from comfy_sdk import Comfy
client = Comfy(api_key="comfyui-...")
wf = client.workflows.from_file("workflow_api.json")
job = client.run(wf)
for output in job.get_outputs("<output-node-id>"):
output.to_file(output.name)The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API). API access requires a Comfy Cloud plan with an API key. SDK docs · Get an API key
FAQ
