CoolFace
Modelpublic

Will223/Wan-Dancer-14B

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face
0likes88downloads
Model Card

Wan-Dancer-14B

<p align="center"> <img src="assets/logo.png" width="400"/> <p>

<p align="center"> πŸ’œ <a href="https://humanaigc.github.io/wan-dancer-project/"><b>Project</b></a> &nbsp&nbsp | &nbsp&nbsp πŸ–₯️ <a href="https://github.com/Wan-Video/Wan-Dancer">GitHub</a> &nbsp&nbsp | &nbsp&nbspπŸ€– <a href="https://modelscope.ai/studios/Wan-AI/Wan-Dancer">MS Space</a>&nbsp&nbsp | &nbsp&nbspπŸ€– <a href="https://www.modelscope.cn/models/Wan-AI/Wan-Dancer-14B">MS Model</a>&nbsp&nbsp | &nbsp&nbspπŸ€— <a href="https://huggingface.co/Wan-AI/Wan-Dancer-14B">HF Model</a>&nbsp&nbsp | &nbsp&nbsp πŸ“‘ <a href="https://arxiv.org/abs/2607.09581">Paper</a> &nbsp&nbsp <br>

**Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation** <be>

πŸ”₯ Latest News!!

  • β€”July 13, 2026: πŸ’ƒ We introduce [Wan-Dancer](https://humanaigc.github.io/wan-dancer-project/), a method can generate long-duration, high-quality, rhythmic dance videos from music with global structure and temporal continuity. We released the model weights and inference code. And now you can try it on ModelScope Studio or HuggingFace Space!

πŸ“‘ Todo List

  • β€”Wan-Dancer Music-to-Dance
  • β€”[x] Inference code of Wan-Dancer
  • β€”[x] Checkpoints of Wan-Dancer
  • β€”[x] ComfyUI integration

Run Wan-Dancer

Installation

Clone the repo:

sh
git clone https://github.com/Wan-Video/Wan-Dancer.git
cd Wan-Dancer

Install dependencies:

sh
python -m venv venv_wan_dancer
source venv_wan_dancer/bin/activate

# Install package in editable mode
pip install -e .

# Install additional and specific versions dependencies
pip install moviepy loguru librosa
pip install https://mirrors.aliyun.com/pytorch-wheels/cu124/torch-2.6.0+cu124-cp310-cp310-linux_x86_64.whl
pip install torchvision==0.21.0
pip install diffusers==0.34.0
pip install yunchang==0.5.0
pip install flash_attn==2.6.3
pip install xfuser==0.4.0
pip install transformers==4.46.2
Model Download
ModelsDownload LinksDescription
Wan-Dancer-14BπŸ€— Huggingface πŸ€– ModelScopeMusic-to-Dance

Download models using huggingface-cli:

sh
pip install "huggingface_hub[cli]"
huggingface-cli download Wan-AI/Wan-Dancer-14B --local-dir ./Wan-Dancer-14B

Download models using modelscope-cli:

sh
pip install modelscope
modelscope download Wan-AI/Wan-Dancer-14B --local_dir ./Wan-Dancer-14B
Run Wan-Dancer

Wan-Dancer can generate long-duration, high-quality, rhythmic dance videos from music with global structure and temporal continuity. Our method decouples the process into global keyframe planning and local temporal refinement, leveraging full-track musical context to ensure long-range coherence.

1. 🎬 Generate Global Keyframe Video

Run the global stage script:

bash
cd Wan-Dancer
./gen_video_global.sh
πŸ”§ Important Parameters
ParameterDescription
seedRandom seed for reproducibility.
image_pathPath to reference image. Example: gen_video/ref_image/1001.jpg
prompt_pathPath to prompt file (defines dance style).<br>Available styles:<ul><li>Chinese Classic Dance: gen_video/prompt/ε€ε…Έθˆž_global.txt</li><li>K-Pop Dance: gen_video/prompt/kpop_global.txt</li><li>Street Dance: gen_video/prompt/θ‘—θˆž_global.txt</li><li>Tap Dance: gen_video/prompt/踒踏舞_global.txt</li><li>Latin Dance: gen_video/prompt/ζ‹‰δΈθˆž_global.txt</li></ul>
music_pathPath to input music file. Example: gen_video/music/ChineseClassicDance.WAV
output_folderOutput directory for generated video.
timestampTimestamp identifier for output files.
num_inference_stepsNumber of diffusion inference steps (e.g., 48).
🌰 Examples
Dance GenresParameterGenerated Global Video
Chinese Classical Danceseed=0<br>imagepath='genvideo/refimage/1001.jpg'<br>promptpath='genvideo/prompt/ε€ε…Έθˆžglobal.txt'<br>musicpath='genvideo/music/ChineseClassicDance.WAV'<br>numinferencesteps=48<br>cfg_scale=5![Chinese Classical Dance](https://cloud.video.taobao.com/vod/mV2fwDpfJ-pODxx6qn-ifq3UMgbze7PcI4cLO_vOo.mp4)
Street Danceseed=0<br>imagepath='genvideo/refimage/2001.jpg'<br>promptpath='genvideo/prompt/θ‘—θˆžglobal.txt'<br>musicpath='genvideo/music/StreetDance.WAV'<br>numinferencesteps=48<br>cfg_scale=5![Street Dance](https://cloud.video.taobao.com/vod/MQiVGjY_ngH3imgfIl37xaQoJfbWadYldlZoMWJFMKQ.mp4)
K-Pop Danceseed=0<br>imagepath='genvideo/refimage/3001.jpg'<br>promptpath='genvideo/prompt/kpopglobal.txt'<br>musicpath='genvideo/musicsuno/3001.WAV'<br>numinferencesteps=48<br>cfgscale=5![K-Pop Dance](https://cloud.video.taobao.com/vod/WGS6Z3VWpgGh8jnt2lrW99XeTB6uu9-H6lCGk1HBLZg.mp4)
Latin Danceseed=0<br>imagepath='genvideo/refimage/4001.jpg'<br>promptpath='genvideo/prompt/ζ‹‰δΈθˆžglobal.txt'<br>musicpath='genvideo/music/LatinDance.WAV'<br>numinferencesteps=48<br>cfg_scale=5![Latin Dance](https://cloud.video.taobao.com/vod/jnwCUj3WvuErBAxF78b-kttEJoegA6-8VmLMZsayBGI.mp4)
Tap Danceseed=0<br>imagepath='genvideo/refimage/5001.jpg'<br>promptpath='genvideo/prompt/踒踏舞global.txt'<br>musicpath='genvideo/music/TapDance.wav'<br>numinferencesteps=48<br>cfg_scale=5![Tap Dance](https://cloud.video.taobao.com/vod/lfrYGNMKzYaLvU3IsMyVJM003T5WZL6QKR7xiifEVAg.mp4)
2. πŸŽ₯ Generate Final High-Resolution Video

Run the local refinement stage:

bash
cd Wan-Dancer
./gen_video_local.sh
πŸ”§ Additional Required Parameters
ParameterDescription
global_video_pathPath to the global video generated in Step 1. Required for local refinement.
prompt_pathPath to prompt file (defines dance style).<br>Available styles:<ul><li>Chinese Classic Dance: gen_video/prompt/ε€ε…Έθˆž_local.txt</li><li>K-Pop Dance: gen_video/prompt/kpop_local.txt</li><li>Street Dance: gen_video/prompt/θ‘—θˆž_local.txt</li><li>Tap Dance: gen_video/prompt/踒踏舞_local.txt</li><li>Latin Dance: gen_video/prompt/ζ‹‰δΈθˆž_local.txt</li></ul>
βœ… All other parameters (seed, image_path, etc.) are identical to Step 1.
🌰 Examples
Dance GenresParameterGenerated Final Video
Chinese Classical Danceseed=0<br>imagepath='genvideo/refimage/1001.jpg'<br>promptpath='genvideo/prompt/ε€ε…Έθˆžlocal.txt'<br>musicpath='genvideo/music/ChineseClassicDance.WAV'<br>numinferencesteps=24<br>cfgscale=5<br>globalvideopath='outputs/globalvideo/1001ChineseClassicDanceseed0.mp4'![Chinese Classical Dance](https://cloud.video.taobao.com/vod/UycK9FTbYM6imr_6jF9aYbNYTiBggyE0EYptc2TRIAw.mp4)
Street Danceseed=0<br>imagepath='genvideo/refimage/2001.jpg'<br>promptpath='genvideo/prompt/θ‘—θˆžlocal.txt'<br>musicpath='genvideo/music/StreetDance.WAV'<br>numinferencesteps=24<br>cfgscale=5<br>globalvideopath='outputs/globalvideo/2001StreetDanceseed0.mp4'![Street Dance](https://cloud.video.taobao.com/vod/JZtIncJf7zPptZAYsQsoSxAtyWr62JfBBikBiTPcY.mp4)
K-Pop Danceseed=100<br>imagepath='genvideo/refimage/3001.jpg'<br>promptpath='genvideo/prompt/kpoplocal.txt'<br>musicpath='genvideo/musicsuno/3001.WAV'<br>numinferencesteps=24<br>cfgscale=5<br>globalvideopath='outputs/globalvideo/3001KPopDance_seed0.mp4'![K-Pop Dance](https://cloud.video.taobao.com/vod/Si5ze8sR0Rm-aPUGSKsTJ2PXJAu3HtnVAzEPM85bkrc.mp4)
Latin Danceseed=0<br>imagepath='genvideo/refimage/4001.jpg'<br>promptpath='genvideo/prompt/ζ‹‰δΈθˆžlocal.txt'<br>musicpath='genvideo/music/LatinDance.WAV'<br>numinferencesteps=24<br>cfgscale=5<br>globalvideopath='outputs/globalvideo/4001LatinDanceseed0.mp4'![Latin Dance](https://cloud.video.taobao.com/vod/kL-0AAqQtigvaidF8Xa8YeTIs4pDLOa_4n5nqXmYiRk.mp4)
Tap Danceseed=0<br>imagepath='genvideo/refimage/5001.jpg'<br>promptpath='genvideo/prompt/踒踏舞local.txt'<br>musicpath='genvideo/music/TapDance.wav'<br>numinferencesteps=24<br>cfgscale=5<br>globalvideopath='outputs/globalvideo/5001TapDanceseed0.mp4'![Tap Dance](https://cloud.video.taobao.com/vod/GbnX-XzekrvNulbbDMw_2kEotadZmUT6KFY5smTkNZ0.mp4)

<strong>Note:</strong> The num_inference_steps should be set to a larger value (e.g., 48) for longer time videos.


Citation

If you use this code or framework in your research, please cite:

bibtex
@article{wan-dancer-2026,
  title         = {Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation},
  author        = {Huang, Mingyang and Zhang, Peng and Hu, Li and Wang, Guangyuan and Zhang, Ruoshi and Lu, Yi and Cheng, Gang and Zhang, Bang},
  year          = {2026},
  eprint        = {2607.09581},
  archiveprefix = {arXiv},
  primaryclass  = {cs.CV},
  url           = {https://arxiv.org/abs/2607.09581},
  note          = {Project page: \url{https://humanaigc.github.io/wan-dancer-project/}}
}

License Agreement

This project is licensed under the Apache 2.0 License β€” see the LICENSE file for details.

Acknowledgements

This work builds upon and integrates components from the following open-source projects:

  1. 1.DiffSynth-Studio
  2. 2.Wan2.1