Datasetpublic

suchirsalhan/Phonemized-UD

Phoneme-UD: A Multilingual Phonemized Universal Dependencies Corpus for 34+ Languages G2P+ Phonemizer We use G2P+ to phonemize Universal Dependencies. Here is an example usage: # Install required packages !apt-get install -y espeak-ng !pip install phonemizer g2p-plus # Set the environment variable from Python import os os.environ["PHONEMIZER_ESPEAK_LIBRARY"] = "/usr/lib/x86_64-linux-gnu/libespeak-ng.so.1" # Now run your transcription from g2p_plus import… See the full description on the dataset page: https://huggingface.co/datasets/suchirsalhan/Phonemized-UD.

sourceHugging Facemitupdated 1y agoView on Hugging Face

0likes840downloads

Dataset Card

Phoneme-UD: A Multilingual Phonemized Universal Dependencies Corpus for 34+ Languages

G2P+ Phonemizer

We use G2P+ to phonemize Universal Dependencies. Here is an example usage:

# Install required packages
!apt-get install -y espeak-ng
!pip install phonemizer g2p-plus
# Set the environment variable from Python
import os
os.environ["PHONEMIZER_ESPEAK_LIBRARY"] = "/usr/lib/x86_64-linux-gnu/libespeak-ng.so.1"

# Now run your transcription
from g2p_plus import transcribe_utterances

lines = ['hello there!', 'nice to meet you.']
phonemized = transcribe_utterances(lines, "phonemizer", "en-gb", keep_word_boundaries=True)
print(phonemized)

@misc{goriely2025ipachildesg2pfeaturerich,
      title={IPA-CHILDES & G2P+: Feature-Rich Resources for Cross-Lingual Phonology and Phonemic Language Modeling}, 
      author={Zébulon Goriely and Paula Buttery},
      year={2025},
      eprint={2504.03036},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2504.03036}, 
}

Attribution

G2P+ incorporates content from the following sources:

—Pingyam by Open Dictionary, licensed under CC BY-SA 3.0. Original work: https://github.com/kfcd/pingyam/tree/master
—CEDICT by MDBG, licensed under CC BY-SA 4.0. Original work: https://www.mdbg.net/chinese/dictionary?page=cc-cedict

In accordance with the CC BY-SA 3.0 license, any derivative work or adaptation of these resources must also be shared under the same license.