skyhong2002/taiwan-professional-exams-115-2-results
Benchmark results produced by any-to-bench. One subset here is one taker configuration — a single model at a single reasoning effort — sat against the exams in another dataset repo. Every row names the exam repo and subset it was earned against, so results from several corpora, and from several people, can live side by side. results-index.json — the catalog: one headline row per configuration results-<entry>/entry.json — that configuration's per-paper scores results-<entry>/raw/<subset>/ —… See the full description on the dataset page: https://huggingface.co/datasets/skyhong2002/taiwan-professional-exams-115-2-results.
<!-- a2b:results:header:start --> Benchmark results produced by any-to-bench. One subset here is one taker configuration — a single model at a single reasoning effort — sat against the exams in another dataset repo. Every row names the exam repo and subset it was earned against, so results from several corpora, and from several people, can live side by side.
results-index.json— the catalog: one headline row per configurationresults-<entry>/entry.json— that configuration's per-paper scoresresults-<entry>/raw/<subset>/— the byte-faithfulbench.json, answer sheet and grade report behind those scores- the viewer table — one row per graded question
Explore it as a leaderboard: https://jacoblincool.github.io/any-to-bench/results.html
from datasets import load_dataset
ds = load_dataset("skyhong2002/taiwan-professional-exams-115-2-results", "results-<entry>", split="test")How to read these numbers
- Judged questions depend on the judge model, which is named per entry. Two configurations graded by different judges are not strictly comparable on their judged half; the rule-graded half is deterministic and always comparable.
- A score is one sample per paper unless the entry's
repeatis above 1. The run-to-run spread of a single sample is unknown. - Input-token counts are not comparable across backends.
codex:reports cached tokens insideinput_tokens;claude:reports them only undercache_read_tokens, leavinginput_tokensnear zero. Output tokens and wall time are the measures that mean the same thing for every taker; the raw per-phase counts are published unaltered so you can judge for yourself. - Token counts for agentic takers are approximate, and wall time depends on how many runs shared the machine — see each entry's note.
- Percentages are over what the taker was actually asked. When two entries cover different papers, their percentages have different denominators. <!-- a2b:results:header:end -->
<!-- a2b:results:board:start -->
Leaderboard
<!-- a2b:results:board:end -->
<!-- a2b:results:entry:codex-gpt-5.6-sol-low:start -->
codex-gpt-5.6-sol-low
a2b results fetch skyhong2002/taiwan-professional-exams-115-2-results --entry codex-gpt-5.6-sol-low -o results <!-- a2b:results:entry:codex-gpt-5.6-sol-low:end -->
<!-- a2b:results:entry:codex-gpt-5.6-sol-medium:start -->
codex-gpt-5.6-sol-medium
a2b results fetch skyhong2002/taiwan-professional-exams-115-2-results --entry codex-gpt-5.6-sol-medium -o results <!-- a2b:results:entry:codex-gpt-5.6-sol-medium:end -->
<!-- a2b:results:entry:codex-gpt-5.6-sol-high:start -->
codex-gpt-5.6-sol-high
a2b results fetch skyhong2002/taiwan-professional-exams-115-2-results --entry codex-gpt-5.6-sol-high -o results <!-- a2b:results:entry:codex-gpt-5.6-sol-high:end -->
<!-- a2b:results:entry:codex-gpt-5.6-sol-xhigh:start -->
codex-gpt-5.6-sol-xhigh
a2b results fetch skyhong2002/taiwan-professional-exams-115-2-results --entry codex-gpt-5.6-sol-xhigh -o results <!-- a2b:results:entry:codex-gpt-5.6-sol-xhigh:end -->
<!-- a2b:results:entry:codex-gpt-5.6-luna-low:start -->
codex-gpt-5.6-luna-low
a2b results fetch skyhong2002/taiwan-professional-exams-115-2-results --entry codex-gpt-5.6-luna-low -o results <!-- a2b:results:entry:codex-gpt-5.6-luna-low:end -->
<!-- a2b:results:entry:codex-gpt-5.6-luna-medium:start -->
codex-gpt-5.6-luna-medium
a2b results fetch skyhong2002/taiwan-professional-exams-115-2-results --entry codex-gpt-5.6-luna-medium -o results <!-- a2b:results:entry:codex-gpt-5.6-luna-medium:end -->
<!-- a2b:results:entry:codex-gpt-5.6-luna-high:start -->
codex-gpt-5.6-luna-high
a2b results fetch skyhong2002/taiwan-professional-exams-115-2-results --entry codex-gpt-5.6-luna-high -o results <!-- a2b:results:entry:codex-gpt-5.6-luna-high:end -->
<!-- a2b:results:entry:codex-gpt-5.6-luna-xhigh:start -->
codex-gpt-5.6-luna-xhigh
a2b results fetch skyhong2002/taiwan-professional-exams-115-2-results --entry codex-gpt-5.6-luna-xhigh -o results <!-- a2b:results:entry:codex-gpt-5.6-luna-xhigh:end -->
