datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
SemEval2024-Task8-SubtaskAUnofficial Mirror of SemEval2024-Task8-SubtaskA Dataset (https://github.com/mbzuai-nlp/SemEval2024-task8)
We have also separately extracted the Chinese subset from the multilingual dataset and stored it in this repository (only the training set includes the Chinese subset).
Our MAGA uses the monolingual test set and the Chinese training set of the SemEval2024-Task8-SubtaskA dataset as external test sets to verify the generalization ability of R-B MAGA.
AlexandriaX_Subtask_3
UBC-NLP/AlexandriaX_Subtask_3
This dataset contains the train/dev splits for AlexandriaX Subtask 3, a dialectal Arabic MT evaluation task.
Participants receive machine-translated outputs with source and reference-side information where applicable. The goal is to detect and classify translation errors using LQM-inspired annotations.
The task has two objectives:
Error span prediction: identify the exact word-level span in the translated text where an error occurs.
Error… See the full description on the dataset page: https://huggingface.co/datasets/UBC-NLP/AlexandriaX_Subtask_3.AlexandriaX_Subtask_3_Test
UBC-NLP/AlexandriaX_Subtask_3_Test
This dataset contains the test split for AlexandriaX Subtask 3, a dialectal Arabic MT evaluation task.
Participants receive machine-translated outputs with source information. The goal is to detect and classify translation errors using LQM-inspired annotations.
Each row contains:
id
direction
source
model_prediction
Example
{
"id": "43571_1",
"direction": "ENG_UAE",
"source": "Come on, be with her. It is nonsense. You do… See the full description on the dataset page: https://huggingface.co/datasets/UBC-NLP/AlexandriaX_Subtask_3_Test.math-sft-subtask-1Mspec_Chem_upsampled_530k_all_subtasks_nothink_datamath-sft-subtask-3subtask-b-examples-testmath-sft-subtask-2math-sft-subtask-0SemEval2024-Task8-SubtaskALibero-Goal-subtasktest_data_subtask1Subtask3ENFullSubtask3HIFull