Skywalker-Harrison-mbz/ArabPref

ArabPref Preference Test

This repository contains the English and Arabic preference test data from ArabPref. It also contains the English and Arabic MCQ test data.

Files

• —pref_test_en.jsonl: 3,300 English examples.
• —pref_test_ar.jsonl: 2,964 Arabic examples.
• —mcq_test_en.jsonl: 992 English multiple-choice questions.
• —mcq_test_ar.jsonl: 992 Arabic multiple-choice questions, including the revised items.

The two files are exposed as separate configurations because they have different language-specific columns. NaN values in the source data were normalized to JSON null.

Columns

pref_en

• —country
• —category
• —aspect
• —prompt_en
• —preferred_behavior_en
• —rejected_behavior_en

pref_ar

• —country
• —category
• —aspect
• —prompt_ar
• —preferred_behavior_ar
• —rejected_behavior_ar

mcq_en

• —country
• —aspect
• —question
• —opa
• —opb
• —opc
• —opd
• —correct_answer
• —positivity
• —num_of_choices

mcq_ar

• —country
• —aspect
• —question_ar
• —opa_ar
• —opb_ar
• —opc_ar
• —opd_ar
• —correct_answer
• —num_of_choices

Loading

from datasets import load_dataset

english = load_dataset("Skywalker-Harrison-mbz/ArabPref", "pref_en", split="test")
arabic = load_dataset("Skywalker-Harrison-mbz/ArabPref", "pref_ar", split="test")
mcq_english = load_dataset("Skywalker-Harrison-mbz/ArabPref", "mcq_en", split="test")
mcq_arabic = load_dataset("Skywalker-Harrison-mbz/ArabPref", "mcq_ar", split="test")