ymoslem/news-commentary-en-ar
This is a filtered version of the English-to-Arabic News Commentary dataset available at data.statmt.org/news-commentary. The filtering process includes removing duplicates, language detection, and semantic filtering based on similarity (>0.70) between the source and translation. The filtering script is available at data-processing.ipynb.
117
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face