ACE Step v1 M2M Editing

The ACE Step v1 M2M Editing workflow in ComfyUI is designed to transform existing songs by altering their style and lyrics. This process is achieved using the ACE-Step model, which excels in audio editing tasks. The workflow incorporates several key nodes, such as TextEncodeAceStepAudio for encoding the desired changes in lyrics and style, and VAEDecodeAudio for decoding the modified audio back into a playable format. By leveraging these nodes, users can seamlessly apply complex edits to audio files, making it a powerful tool for music producers and audio engineers looking to experiment with new sounds or adapt existing tracks to different genres.

Technically, the workflow begins with loading the audio file using the LoadAudio node, followed by encoding the audio with VAEEncodeAudio. The encoded audio is then processed through various nodes, such as LatentApplyOperationCFG and LatentOperationTonemapReinhard, to adjust and refine the audio's characteristics. The ModelSamplingSD3 node is employed to sample the audio, while the KSampler node ensures high-quality output. Finally, the edited audio is saved in MP3 format using the SaveAudioMP3 node. This comprehensive approach allows for precise control over the audio editing process, making it an invaluable tool for creative professionals.

API

Use this workflow from code

Every Comfy workflow is a JSON graph. The payload below is this workflow, exactly as ComfyUI runs it — fetch it from the URL, keep it in version control, or load it in ComfyUI and run it node by node.

GET https://comfy.org/workflows/download/4f8b62bfd681.json
Fetching workflow JSON…

Run it from Python or TypeScript with the Comfy SDK. The same code targets Comfy Cloud or a ComfyUI you host yourself — only the base URL changes.

# Install (beta)
pip install comfy-sdk        # Python
npm i @comfyorg/sdk          # TypeScript

# Run "ACE Step v1 M2M Editing" (Python)
from comfy_sdk import Comfy

client = Comfy(api_key="comfyui-...")

# This workflow, exported in API format (see note below)
wf = client.workflows.from_file("audio_ace_step_1_m2m_editing_api.json")

job = client.run(wf)
for output in job.get_outputs("59"):  # SaveAudioMP3
    output.to_file(output.name)

The SDK takes a workflow in API format: open this workflow in ComfyUI and use File → Export Workflow (API). API access requires a Comfy Cloud plan with an API key. SDK docs · Get an API key

FAQ

Frequently Asked Questions

View all workflows
Character
Cinematic
Image to Video
Lip Sync
Multiple Angles
Portrait
Style Reference
Style Transfer
Text to Video
Video Generation
Video
Showing 30 of 30 templates