The 'LTX-2 Canny to Video' workflow is designed to transform edge-detected images into high-quality videos with synchronized audio. Utilizing the LTX-2 model, this workflow leverages the Canny edge detection technique to ensure precise edge control and structural consistency throughout the video. The process begins with the 'LoadVideo' node to import your source video, which is then decomposed into its components using the 'GetVideoComponents' node. The 'Canny' node plays a crucial role by detecting edges in the images, providing a guide for the video generation process.
This workflow is particularly useful for creators who need to maintain the structural integrity of the original footage while enhancing it with AI-generated elements. The LTX-2 model, developed by Lightricks, ensures that the generated video maintains high quality and coherence. The workflow also includes nodes like 'ImageScaleBy' and 'ResizeImageMaskNode' for adjusting image dimensions, and 'SaveVideo' to compile and save the final video. By following the recommended settings and parameters, users can achieve optimal results with minimal manual intervention.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
GET https://comfy.org/workflows/download/f052abfce10e.jsonFetching workflow JSON…
Run it from Python or TypeScript with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
# Install (beta)
pip install comfy-sdk # Python
npm i @comfyorg/sdk # TypeScript
# Run "LTX-2 Canny to Video" (Python)
from comfy_sdk import Comfy
client = Comfy(api_key="comfyui-...")
# This workflow, exported in API format (see note below)
wf = client.workflows.from_file("video_ltx2_canny_to_video_api.json")
asset = client.assets.from_file("input.png")
wf.set_input("160", "image", asset) # LoadImage
job = client.run(wf)
for output in job.get_outputs("175"): # SaveVideo
output.to_file(output.name)The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API). API access requires a Comfy Cloud plan with an API key. SDK docs · Get an API key
FAQ
