CoolFace
Datasetpublic

Tincan0325/smoea-15ood-benchmark

SMoEA fixed 15-OOD benchmark data The evaluation data for scripts/run_rejection_benchmark.py. Not needed for interactive or batch mode — only the benchmark reads it. Getting it scripts/setup_workspace.sh downloads this for you into dataset/ood_data/, which is what --benchmark-root defaults to. To fetch it on its own: python scripts/fetch_benchmark.py --repo Tincan0325/smoea-15ood-benchmark That verifies the per-group counts on arrival. The plain hf command works… See the full description on the dataset page: https://huggingface.co/datasets/Tincan0325/smoea-15ood-benchmark.

sourceHugging Faceotherupdated 1mo agoView on Hugging Face
0likes8downloads
15 commits on main
030b6cf1mo ago

flat layout: SHA256SUMS

Tincan0325
17741a51mo ago

flat layout: README.md

Tincan0325
80964561mo ago

drop legacy nested layout: dataset/

Tincan0325
2e6542e1mo ago

drop legacy nested layout: ood/

Tincan0325
7bcd0761mo ago

drop legacy nested layout: prompts/

Tincan0325
80763f91mo ago

add flat layout: task933_test.json

Tincan0325
62aeebe1mo ago

add flat layout: task476_test.json

Tincan0325
76d2ba21mo ago

add flat layout: task1670_test.json

Tincan0325
e967c2b1mo ago

add flat layout: task1622_test.json

Tincan0325
0936e821mo ago

add flat layout: task149_test.json

Tincan0325
c517a631mo ago

add flat layout: ni_task_descriptions.json

Tincan0325
e0a6fad1mo ago

add flat layout: mmlu_pro_test.json

Tincan0325
03bf0ea1mo ago

add flat layout: bbh_test.json

Tincan0325
e68d3701mo ago

SMoEA fixed 15-OOD benchmark data (4159 answer-free prompts)

Tincan0325
c3886911mo ago

initial commit

Tincan0325