diegotg343/PitchFlower

🌸 PitchFlower

<p align="left"> <a href="https://arxiv.org/abs/2510.25566"> <img src="https://img.shields.io/badge/arXiv-PitchFlower-b31b1b?logo=arxiv&logoColor=white" alt="arXiv"> </a> <a href="https://github.com/diegotg2000/PitchFlower"> <img src="https://img.shields.io/badge/GitHub-PitchFlower-181717?logo=github" alt="GitHub"> </a> </p>

Official pretrained checkpoint of the paper PitchFlower: A flow-based neural audio codec with pitch controllability.

🧠 Overview

PitchFlower achieves pitch controllability by means of a perturbation strategy. During inference, pitch information is removed by applying a random flattening and shifting operation. The model is trained with a reconstruction task, providing pitch information explicitly.

<p align="center"> <img src="pitchflower_diagram.png" alt="PitchFlower architecture" width="600"> </p>

We use an autoencoder with an RVQ bottleneck and a flow-based decoder to produce high-quality audio. More details can be found in the paper.

📦 Installation and Usage

Check out our GitHub repo to learn how to use PitchFlower https://github.com/diegotg2000/PitchFlower

🙌 Acknowledgements

We'd like to acknowledge the repositories from which we draw inspiration and parts of the code

• —Vocos: https://github.com/gemelo-ai/vocos
• —WavTokenizer: https://github.com/jishengpeng/WavTokenizer
• —Encodec: https://github.com/facebookresearch/encodec

This work has been done in the Analysis/Synthesis team of the STMS laboratory at IRCAM. It has been funded by the ANR project EVA.

📫 Contact

For questions or collaboration opportunities, feel free to reach out: dtorres@ircam.fr

🧩 Citation

@misc{pitchflower,
      title={PitchFlower: A flow-based neural audio codec with pitch controllability}, 
      author={Diego Torres and Axel Roebel and Nicolas Obin},
      year={2025},
      eprint={2510.25566},
      archivePrefix={arXiv},
      url={https://arxiv.org/abs/2510.25566}, 
}

📜 License

This project is licensed under the CC BY-NC-SA 4.0 license.