ymoslem/UN-Arabic-English-Filtered
Dataset Details MultiUN + UNPC datasets, with rule-based and semantic filtering (train > 0.45 - test/dev > 0.9) as well as (>= 0.1) fasttext language detection. Dataset Structure DatasetDict({ train: Dataset({ features: ['text_en', 'text_ar'], num_rows: 19279407 }) test: Dataset({ features: ['text_en', 'text_ar'], num_rows: 8752 }) dev: Dataset({ features: ['text_en', 'text_ar'], num_rows: 8752… See the full description on the dataset page: https://huggingface.co/datasets/ymoslem/UN-Arabic-English-Filtered.
This repository belongs to ymoslem on Hugging Face.
CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.