The LTX-2 Pose to Video workflow is designed to transform pose guidance into high-quality video content with synchronized audio and video generation. Utilizing the LTX-2 model from Lightricks, this workflow offers precise control over pose and expressive motion, making it ideal for creating dynamic video content. The workflow integrates various nodes such as GetVideoComponents, PreviewImage, and SaveVideo, which help in breaking down the video into components, previewing frames, and saving the final output, respectively. A key feature of this workflow is its use of the comfyui_controlnet_aux custom nodes, which enhance the precision of pose control and motion expression.
Technically, the workflow begins with video and image preprocessing using nodes like LoadVideo and ResizeImageMaskNode. It then employs the DWPreprocessor for refining video settings, ensuring optimal frame count and resolution. The workflow is designed to handle resolutions up to 1920x1088, though it defaults to 720p for efficiency. The frame count must be divisible by 8 plus 1, ensuring smooth transitions and synchronization. This workflow is particularly useful for creators seeking to produce videos with detailed motion and synchronized audio, leveraging the power of the LTX-2 model to achieve professional-grade results.
API
Use this workflow from code
Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.
GET https://comfy.org/workflows/download/3cf3c6a082ed.jsonFetching workflow JSON…
Run it from Python or TypeScript with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.
# Install (beta)
pip install comfy-sdk # Python
npm i @comfyorg/sdk # TypeScript
# Run "LTX-2 Pose to Video" (Python)
from comfy_sdk import Comfy
client = Comfy(api_key="comfyui-...")
# This workflow, exported in API format (see note below)
wf = client.workflows.from_file("video_ltx2_pose_to_video_api.json")
asset = client.assets.from_file("input.png")
wf.set_input("160", "image", asset) # LoadImage
job = client.run(wf)
for output in job.get_outputs("175"): # SaveVideo
output.to_file(output.name)The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API). API access requires a Comfy Cloud plan with an API key. SDK docs · Get an API key
FAQ
