yinanli1215/Sound2Hap

[Last Update Feb 6 2026]

1. 1.The 1000 sound clips (audio1000 folder) are from: ESC-50: Dataset for Environmental Sound Classification https://github.com/karoldvl/ESC-50/ @inproceedings{piczak2015dataset, title = {{ESC}: {Dataset} for {Environmental Sound Classification}}, author = {Piczak, Karol J.}, booktitle = {Proceedings of the 23rd {Annual ACM Conference} on {Multimedia}}, date = {2015-10-13}, url = {http://dl.acm.org/citation.cfm?doid=2733373.2806390}, doi = {10.1145/2733373.2806390}, location = {{Brisbane, Australia}}, isbn = {978-1-4503-3459-4}, publisher = {{ACM Press}}, pages = {1015--1018} }

1. 1.The 4000 vibrations (vibration4000 folder) are created by algorithms adapted from:
2. 2.Frequench Shifting: @incollection{okazaki2015effect, title={The effect of frequency shifting on audio--tactile conversion for enriching musical experience}, author={Okazaki, Ryuta and Kuribayashi, Hidenori and Kajimoto, Hiroyuki}, booktitle={Haptic Interaction: Perception, Devices and Applications}, pages={45--51}, year={2015}, publisher={Springer} }
3. 3.Perceptual Mapping: @inproceedings{lee2013real, title={Real-time perception-level translation from audio signals to vibrotactile effects}, author={Lee, Jaebong and Choi, Seungmoon}, booktitle={Proceedings of the SIGCHI Conference on Human Factors in Computing Systems}, pages={2567--2576}, year={2013} }
4. 4.Pitch Match: @article{kim2023sound, title={Sound-to-touch crossmodal pitch matching for short sounds}, author={Kim, Dong-Geun and Lee, Jungeun and Yun, Gyeore and Tan, Hong Z and Choi, Seungmoon}, journal={IEEE Transactions on Haptics}, volume={17}, number={1}, pages={2--7}, year={2023}, publisher={IEEE} }
5. 5.HapticGen: @inproceedings{sung2025hapticgen, title={HapticGen: Generative Text-to-Vibration Model for Streamlining Haptic Design}, author={Sung, Youjin and John, Kevin and Yoon, Sang Ho and Seifi, Hasti}, booktitle={Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems}, pages={1--24}, year={2025}

1. 1.Finalratings1000_clips.xlsx contains the averaged human ratings (4000 ratings) for each vibration of each sound clip.

1. 1.Initialratings1000_clips.xlsx contains two raters' raw ratings (8000 ratings) for each vibration of each sound clip.

1. 1.If you find this dataset useful in an academic setting please cite:

@inproceedings{li2026sound2hap,
  title={Sound2Hap: Learning Audio-to-Vibrotactile Haptic Generation from Human Ratings},
  author={Li, Yinan and Seifi, Hasti},
  booktitle={Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems},
  pages={1--19},
  year={2026}
}