herwoww/MultiDiac
Are LLMs Good Text Diacritizers? An Arabic and Yorùbá Case Study Hawau Olamide Toyin, Samar Magdy, Hanan Aldarmaki We investigate the effectiveness of large language models (LLMs) for text diacritization in two typologically distinct languages: Arabic and Yoruba. To enable a rigorous evaluation, we introduce a novel multilingual dataset MultiDiac , with diverse samples that capture a range of diacritic ambiguities. We evaluate 14 LLMs varying in size, accessibility, and language… See the full description on the dataset page: https://huggingface.co/datasets/herwoww/MultiDiac.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face