CoolFace
Apppublic

ACE-Step/Ace-Step-v1.5

sourceHugging Facemitupdated 6mo agoView on Hugging Face
580likes
App README

<h1 align="center">ACE-Step 1.5</h1> <h1 align="center">Pushing the Boundaries of Open-Source Music Generation</h1> <p align="center"> <a href="https://ace-step.github.io/ace-step-v1.5.github.io/">Project</a> | <a href="https://huggingface.co/collections/ACE-Step/ace-step-15">Hugging Face</a> | <a href="https://modelscope.cn/models/ACE-Step/ACE-Step-v1-5">ModelScope</a> | <a href="https://huggingface.co/spaces/ACE-Step/Ace-Step-v1.5">Space Demo</a> | <a href="https://discord.gg/PeWDxrkdj7">Discord</a> | <a href="https://arxiv.org/abs/2602.00744">Technical Report</a> </p>

<p align="center"> <img src="./assets/orgnization_logos.png" width="100%" alt="StepFun Logo"> </p>

Table of Contents

📝 Abstract

We present ACE-Step v1.5, a highly efficient foundation model that democratizes commercial-grade music production on consumer hardware. Optimized for local deployment (<4GB VRAM), the model accelerates generation by over 100× compared to traditional pure LM architectures, producing superior high-fidelity audio in seconds characterized by coherent semantics and exceptional melodies. At its core lies a novel hybrid architecture where the Language Model (LM) functions as an omni-capable planner: it transforms simple user queries into comprehensive song blueprints—scaling from short loops to 10-minute compositions—while synthesizing metadata, lyrics, and captions via Chain-of-Thought to guide the Diffusion Transformer (DiT). Uniquely, this alignment is achieved through intrinsic reinforcement learning relying solely on the model’s internal mechanisms, thereby eliminating the biases inherent in external reward models or human preferences. Beyond standard synthesis, ACE-Step v1.5 unifies precise stylistic control with versatile editing capabilities—such as cover generation, repainting, and vocal-to-BGM conversion—while maintaining strict adherence to prompts across 50+ languages.

✨ Features

<p align="center"> <img src="./assets/application_map.png" width="100%" alt="ACE-Step Framework"> </p>

⚡ Performance

  • Ultra-Fast Generation — 0.5s to 10s generation time on A100 (depending on think mode & diffusion steps)
  • Flexible Duration — Supports 10 seconds to 10 minutes (600s) audio generation
  • Batch Generation — Generate up to 8 songs simultaneously

🎵 Generation Quality

  • Commercial-Grade Output — Quality between Suno v4.5 and Suno v5
  • Rich Style Support — 1000+ instruments and styles with fine-grained timbre description
  • Multi-Language Lyrics — Supports 50+ languages with lyrics prompt for structure & style control

🎛️ Versatility & Control

FeatureDescription
✅ Reference Audio InputUse reference audio to guide generation style
✅ Cover GenerationCreate covers from existing audio
✅ Repaint & EditSelective local audio editing and regeneration
✅ Track SeparationSeparate audio into individual stems
✅ Multi-Track GenerationAdd layers like Suno Studio's "Add Layer" feature
✅ Vocal2BGMAuto-generate accompaniment for vocal tracks
✅ Metadata ControlControl duration, BPM, key/scale, time signature
✅ Simple ModeGenerate full songs from simple descriptions
✅ Query RewritingAuto LM expansion of tags and lyrics
✅ Audio UnderstandingExtract BPM, key/scale, time signature & caption from audio
✅ LRC GenerationAuto-generate lyric timestamps for generated music
✅ LoRA TrainingOne-click annotation & training in Gradio. 8 songs, 1 hour on 3090 (12GB VRAM)
✅ Quality ScoringAutomatic quality assessment for generated audio

📦 Installation

Requirements: Python 3.11, CUDA GPU recommended (works on CPU/MPS but slower)

1. Install uv (Package Manager)

bash
# macOS / Linux
curl -LsSf https://astral.sh/uv/install.sh | sh

# Windows (PowerShell)
powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"

2. Clone & Install

bash
git clone https://github.com/ACE-Step/ACE-Step-1.5.git
cd ACE-Step-1.5
uv sync

3. Launch

🖥️ Gradio Web UI (Recommended)
bash
uv run acestep

Open http://localhost:7860 in your browser. Models will be downloaded automatically on first run.

🌐 REST API Server
bash
uv run acestep-api

API runs at http://localhost:8001. See API Documentation for endpoints.

Command Line Options

Gradio UI (`acestep`):

OptionDefaultDescription
--port7860Server port
--server-name127.0.0.1Server address (use 0.0.0.0 for network access)
--sharefalseCreate public Gradio link
--languageenUI language: en, zh, ja
--init_servicefalseAuto-initialize models on startup
--config_pathautoDiT model (e.g., acestep-v15-turbo, acestep-v15-turbo-shift3)
--lm_model_pathautoLM model (e.g., acestep-5Hz-lm-0.6B, acestep-5Hz-lm-1.7B)
--offload_to_cpuautoCPU offload (auto-enabled if VRAM < 16GB)

Examples:

bash
# Public access with Chinese UI
uv run acestep --server-name 0.0.0.0 --share --language zh

# Pre-initialize models on startup
uv run acestep --init_service true --config_path acestep-v15-turbo

Development

bash
# Add dependencies
uv add package-name
uv add --dev package-name

# Update all dependencies
uv sync --upgrade

🚀 Usage

We provide multiple ways to use ACE-Step:

MethodDescriptionDocumentation
🖥️ Gradio Web UIInteractive web interface for music generationGradio Guide
🐍 Python APIProgrammatic access for integrationInference API
🌐 REST APIHTTP-based async API for servicesREST API

📚 Documentation available in: English | 中文 | 日本語

🔨 Train

See the LoRA Training tab in Gradio UI for one-click training, or check Gradio Guide - LoRA Training for details.

🏗️ Architecture

<p align="center"> <img src="./assets/ACE-Step_framework.png" width="100%" alt="ACE-Step Framework"> </p>

🦁 Model Zoo

<p align="center"> <img src="./assets/model_zoo.png" width="100%" alt="Model Zoo"> </p>

DiT Models

DiT ModelPre-TrainingSFTRLCFGStepRefer audioText2MusicCoverRepaintExtractLegoCompleteQualityDiversityFine-TunabilityHugging Face
acestep-v15-base50MediumHighEasyLink
acestep-v15-sft50HighMediumEasyLink
acestep-v15-turbo8Very HighMediumMediumLink
acestep-v15-turbo-rl8Very HighMediumMediumTo be released

LM Models

LM ModelPretrain fromPre-TrainingSFTRLCoT metasQuery rewriteAudio UnderstandingComposition CapabilityCopy MelodyHugging Face
acestep-5Hz-lm-0.6BQwen3-0.6BMediumMediumWeak
acestep-5Hz-lm-1.7BQwen3-1.7BMediumMediumMedium
acestep-5Hz-lm-4BQwen3-4BStrongStrongStrongTo be released

📜 License & Disclaimer

This project is licensed under MIT

ACE-Step enables original music generation across diverse genres, with applications in creative production, education, and entertainment. While designed to support positive and artistic use cases, we acknowledge potential risks such as unintentional copyright infringement due to stylistic similarity, inappropriate blending of cultural elements, and misuse for generating harmful content. To ensure responsible use, we encourage users to verify the originality of generated works, clearly disclose AI involvement, and obtain appropriate permissions when adapting protected styles or materials. By using ACE-Step, you agree to uphold these principles and respect artistic integrity, cultural diversity, and legal compliance. The authors are not responsible for any misuse of the model, including but not limited to copyright violations, cultural insensitivity, or the generation of harmful content.

🔔 Important Notice The only official website for the ACE-Step project is our GitHub Pages site. We do not operate any other websites. 🚫 Fake domains include but are not limited to: ac\\p.com, a\\p.org, a\\\*c.org ⚠️ Please be cautious. Do not visit, trust, or make payments on any of those sites.

🙏 Acknowledgements

This project is co-led by ACE Studio and StepFun.

📖 Citation

If you find this project useful for your research, please consider citing:

BibTeX
@misc{gong2026acestep,
	title={ACE-Step 1.5: Pushing the Boundaries of Open-Source Music Generation},
	author={Junmin Gong, Song Yulin, Wenxiao Zhao, Sen Wang, Shengyuan Xu, Jing Guo}, 
	howpublished={\url{https://github.com/ace-step/ACE-Step-1.5}},
	year={2026},
	note={GitHub repository}
}