CoolFace
Apppublic

mtg-upf/audio-difficulty

sourceHugging Faceupdated 1y agoView on Hugging Face
2likes
App README

🎼 Music Difficulty Estimator

This Gradio app estimates the difficulty of piano pieces based on uploaded audio (MP3/MP4) or YouTube links. It uses pretrained models to generate a MIDI transcription and predict difficulty from three musical perspectives:

  • —CQT-based representation
  • —Piano roll representation
  • —Multimodal embeddings

🛠 How it works

  1. 1.You upload an audio or video file, or paste a YouTube link.
  2. 2.The audio is transcribed to MIDI using a piano transcription model.
  3. 3.Three different difficulty models analyze the audio and generate predictions.
  4. 4.You can listen to the extracted MP3 and the generated MIDI.

📦 Model loading

All models are stored separately in the pramoneda/audio model repository and are downloaded dynamically via huggingface_hub.

📁 Input formats

  • —MP3 audio
  • —MP4 video (audio extracted automatically)
  • —YouTube links

✨ Built with

  • —gradio for the interface
  • —pydub and yt_dlp for audio processing
  • —huggingface_hub to load model checkpoints
  • —ffmpeg-python for format conversion

🔗 Related