Datasetpublic
JacobLinCool/taiwan-exams-results
Benchmark results produced by any-to-bench. One subset here is one taker configuration — a single model at a single reasoning effort — sat against the exams in another dataset repo. Every row names the exam repo and subset it was earned against, so results from several corpora, and from several people, can live side by side. results-index.json — the catalog: one headline row per configuration results-<entry>/entry.json — that configuration's per-paper scores results-<entry>/raw/<subset>/ —… See the full description on the dataset page: https://huggingface.co/datasets/JacobLinCool/taiwan-exams-results.
0likes220downloads
Dataset Card
<!-- a2b:results:header:start --> Benchmark results produced by any-to-bench. One subset here is one taker configuration — a single model at a single reasoning effort — sat against the exams in another dataset repo. Every row names the exam repo and subset it was earned against, so results from several corpora, and from several people, can live side by side.
- —
results-index.json— the catalog: one headline row per configuration - —
results-<entry>/entry.json— that configuration's per-paper scores - —
results-<entry>/raw/<subset>/— the byte-faithfulbench.json, answer sheet and grade report behind those scores - —the viewer table — one row per graded question
Resource-backed runs also publish their actual file/byte exposure and deterministic citation checks. Citations are evidence metadata only and never change the score.
Explore it as a leaderboard: https://jacoblincool.github.io/any-to-bench/results.html
python
from datasets import load_dataset
ds = load_dataset("JacobLinCool/taiwan-exams-results", "results-<entry>", split="test")How to read these numbers
- —Judged questions depend on the judge model, which is named per entry. Two configurations graded by different judges are not strictly comparable on their judged half; the rule-graded half is deterministic and always comparable.
- —A score is one sample per paper unless the entry's
repeatis above 1. The run-to-run spread of a single sample is unknown. - —Input-token counts are not comparable across backends.
codex:reports cached tokens insideinput_tokens;claude:andagy:report cache reads separately undercache_read_tokens. Output tokens and wall time are the measures that mean the same thing for every taker; the raw per-phase counts are published unaltered so you can judge for yourself. - —Token counts for agentic takers are approximate, and wall time depends on how many runs shared the machine — see each entry's note.
- —Percentages are over what the taker was actually asked. When two entries cover different papers, their percentages have different denominators. <!-- a2b:results:header:end -->
<!-- a2b:results:board:start -->
Leaderboard
| # | Model | Effort | Papers | Score | % | Rule-graded % | Solve output tokens | Solve s |
|---|---|---|---|---|---|---|---|---|
| 1 | codex:gpt-6-astra | medium | 61 | 5638.1/5748 | 98.1% | 98.1% | 97,045 | 4,807 |
| 2 | codex:gpt-6-astra | high | 61 | 5635.7/5748 | 98.0% | 98.1% | 134,498 | 5,969 |
| 3 | codex:gpt-6-astra | xhigh | 61 | 5629.2/5748 | 97.9% | 98.0% | 258,684 | 10,418 |
| 4 | codex:gpt-6-astra | low | 61 | 5621.4/5748 | 97.8% | 97.7% | 80,631 | 4,157 |
| 5 | claude:claude-opus-5 | xhigh | 61 | 5617.8/5748 | 97.7% | 98.0% | 1,977,197 | 29,371 |
| 6 | claude:claude-opus-5 | high | 61 | 5615.7/5748 | 97.7% | 97.9% | 1,426,543 | 22,986 |
| 7 | codex:gpt-5.6-sol | xhigh | 61 | 5592.8/5748 | 97.3% | 97.4% | 712,063 | 18,607 |
| 8 | claude:claude-opus-5 | medium | 61 | 5592.4/5748 | 97.3% | 97.5% | 838,907 | 14,329 |
| 9 | codex:gpt-5.6-sol | high | 61 | 5570.8/5748 | 96.9% | 96.9% | 536,470 | 13,556 |
| 10 | claude:claude-opus-5 | low | 61 | 5564.3/5748 | 96.8% | 97.0% | 528,996 | 9,075 |
| 11 | codex:gpt-5.6-sol | medium | 61 | 5531.2/5748 | 96.2% | 96.4% | 415,688 | 10,548 |
| 12 | claude:claude-sonnet-5 | xhigh | 61 | 5485.4/5748 | 95.4% | 95.6% | 3,956,876 | 48,040 |
| 13 | codex:gpt-5.6-sol | low | 61 | 5480.1/5748 | 95.3% | 95.4% | 278,142 | 7,402 |
| 14 | google-cloud:gemini-3.7-flash | high | 21 | 1664.5/1748 | 95.2% | 95.6% | 696,272 | 1,174 |
| 15 | claude:claude-sonnet-5 | high | 61 | 5452.5/5748 | 94.9% | 95.1% | 2,829,706 | 35,059 |
| 16 | google-cloud:gemini-3.7-flash | medium | 21 | 1649.3/1748 | 94.4% | 94.5% | 423,991 | 823 |
| 17 | codex:gpt-5.6-luna | xhigh | 61 | 5416/5748 | 94.2% | 94.4% | 1,039,142 | 20,831 |
| 18 | google-cloud:gemini-3.7-flash | low | 21 | 1646.9/1748 | 94.2% | 94.5% | 304,047 | 800 |
| 19 | claude:claude-sonnet-5 | medium | 61 | 5410.6/5748 | 94.1% | 94.5% | 1,616,036 | 23,419 |
| 20 | claude:claude-sonnet-5 | low | 61 | 5364.8/5748 | 93.3% | 93.6% | 457,959 | 16,039 |
| 21 | codex:gpt-5.6-luna | high | 61 | 5364.4/5748 | 93.3% | 93.8% | 767,453 | 15,584 |
| 22 | codex:gpt-5.6-luna | medium | 61 | 5176/5748 | 90.0% | 90.2% | 369,257 | 7,843 |
| 23 | codex:gpt-5.6-luna | low | 61 | 4740.2/5748 | 82.5% | 83.3% | 213,613 | 4,904 |
Not every configuration sat the same papers — see the Papers column. Each percentage is over its own denominator, so this ordering is not a like-for-like ranking. Score them on a shared set of papers in the viewer: https://jacoblincool.github.io/any-to-bench/results.html <!-- a2b:results:board:end -->
<!-- a2b:results:entry:codex-gpt-5-6-luna-low:start -->
codex-gpt-5-6-luna-low
| Model | codex:gpt-5.6-luna |
| Effort | low |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.2 |
| Ran | 2026-08-23 |
| Note | thirty-two agents in parallel on one machine |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 81/100 | 81.0% | 80.0% | 85.0% |
ast-115-chemistry | 69.8/100 | 69.8% | 74.1% | 50.0% |
ast-115-civics | 75/100 | 75.0% | 76.3% | 70.8% |
ast-115-geography | 66/100 | 66.0% | 82.9% | 26.7% |
ast-115-history | 94/100 | 94.0% | 95.0% | 90.0% |
ast-115-math-jia | 75.6/100 | 75.6% | 76.4% | 72.7% |
ast-115-math-yi | 86.8/100 | 86.8% | 95.9% | 54.5% |
ast-115-physics | 71/100 | 71.0% | 68.8% | 78.3% |
cap-115-chinese | 41/42 | 97.6% | 97.6% | – |
cap-115-english-reading | 40/43 | 93.0% | 93.0% | – |
cap-115-math | 23/31 | 74.2% | 68.0% | 100.0% |
cap-115-science | 37/50 | 74.0% | 74.0% | – |
cap-115-social | 49/54 | 90.7% | 90.7% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 79.6/100 | 79.6% | 82.0% | 70.0% |
gsat-115-chinese-writing | 48/50 | 96.0% | – | 96.0% |
gsat-115-english | 89/100 | 89.0% | 85.7% | 96.7% |
gsat-115-math-a | 56/100 | 56.0% | 63.6% | 0.0% |
gsat-115-math-b | 77/100 | 77.0% | 80.7% | 50.0% |
gsat-115-science | 82.4/128 | 64.4% | 67.8% | 53.3% |
gsat-115-social | 105/144 | 72.9% | 79.6% | 52.8% |
tve-115-agriculture-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-agriculture-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-aquaculture-1 | 74/100 | 74.0% | 74.0% | – |
tve-115-aquaculture-2 | 86/100 | 86.0% | 86.0% | – |
tve-115-art-film-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-art-film-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-business-management-1 | 72/100 | 72.0% | 72.0% | – |
tve-115-business-management-2 | 82/100 | 82.0% | 82.0% | – |
tve-115-chemical-engineering-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-chemical-engineering-2 | 86/100 | 86.0% | 86.0% | – |
tve-115-child-care-2 | 86/100 | 86.0% | 86.0% | – |
tve-115-chinese | 84/100 | 84.0% | 84.2% | 83.3% |
tve-115-civil-architecture-1 | 72.5/100 | 72.5% | 72.5% | – |
tve-115-civil-architecture-2 | 67.5/100 | 67.5% | 67.5% | – |
tve-115-computer-electronics-2 | 76/100 | 76.0% | 76.0% | – |
tve-115-design-1 | 86/100 | 86.0% | 86.0% | – |
tve-115-electrical-2 | 86/100 | 86.0% | 86.0% | – |
tve-115-electrical-electronics-1 | 56/100 | 56.0% | 56.0% | – |
tve-115-engineering-management-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-engineering-management-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-food-2 | 80/100 | 80.0% | 80.0% | – |
tve-115-foreign-language-english-2 | 98/100 | 98.0% | 96.7% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 80/100 | 80.0% | 80.0% | – |
tve-115-hospitality-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-hospitality-2 | 72/100 | 72.0% | 72.0% | – |
tve-115-life-application-2 | 82/100 | 82.0% | 82.0% | – |
tve-115-maritime-1 | 80/100 | 80.0% | 80.0% | – |
tve-115-maritime-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-math-a | 68/100 | 68.0% | 68.0% | – |
tve-115-math-b | 96/100 | 96.0% | 96.0% | – |
tve-115-math-c | 92/100 | 92.0% | 92.0% | – |
tve-115-mechanical-1 | 85/100 | 85.0% | 85.0% | – |
tve-115-mechanical-2 | 78/100 | 78.0% | 78.0% | – |
tve-115-power-mechanical-1 | 80/100 | 80.0% | 80.0% | – |
tve-115-power-mechanical-2 | 65/100 | 65.0% | 65.0% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry codex-gpt-5-6-luna-low -o results <!-- a2b:results:entry:codex-gpt-5-6-luna-low:end -->
<!-- a2b:results:entry:codex-gpt-5-6-luna-medium:start -->
codex-gpt-5-6-luna-medium
| Model | codex:gpt-5.6-luna |
| Effort | medium |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.2 |
| Ran | 2026-08-23 |
| Note | thirty-two agents in parallel on one machine |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 88.6/100 | 88.6% | 88.2% | 90.0% |
ast-115-chemistry | 82.4/100 | 82.4% | 81.0% | 88.9% |
ast-115-civics | 67.2/100 | 67.2% | 67.4% | 66.7% |
ast-115-geography | 74/100 | 74.0% | 91.4% | 33.3% |
ast-115-history | 96.8/100 | 96.8% | 98.5% | 90.0% |
ast-115-math-jia | 72.4/100 | 72.4% | 64.6% | 100.0% |
ast-115-math-yi | 96.8/100 | 96.8% | 95.9% | 100.0% |
ast-115-physics | 84/100 | 84.0% | 83.1% | 87.0% |
cap-115-chinese | 41/42 | 97.6% | 97.6% | – |
cap-115-english-reading | 42/43 | 97.7% | 97.7% | – |
cap-115-math | 29/31 | 93.5% | 96.0% | 83.3% |
cap-115-science | 42/50 | 84.0% | 84.0% | – |
cap-115-social | 49/54 | 90.7% | 90.7% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 80/100 | 80.0% | 80.0% | 80.0% |
gsat-115-chinese-writing | 49/50 | 98.0% | – | 98.0% |
gsat-115-english | 92/100 | 92.0% | 88.6% | 100.0% |
gsat-115-math-a | 91/100 | 91.0% | 89.8% | 100.0% |
gsat-115-math-b | 83/100 | 83.0% | 80.7% | 100.0% |
gsat-115-science | 108.8/128 | 85.0% | 86.5% | 80.0% |
gsat-115-social | 121/144 | 84.0% | 83.3% | 86.1% |
tve-115-agriculture-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-agriculture-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-aquaculture-1 | 78/100 | 78.0% | 78.0% | – |
tve-115-aquaculture-2 | 88/100 | 88.0% | 88.0% | – |
tve-115-art-film-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-art-film-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-business-management-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-business-management-2 | 88/100 | 88.0% | 88.0% | – |
tve-115-chemical-engineering-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-chemical-engineering-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-child-care-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-chinese | 90/100 | 90.0% | 89.5% | 91.7% |
tve-115-civil-architecture-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-civil-architecture-2 | 87.5/100 | 87.5% | 87.5% | – |
tve-115-computer-electronics-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-design-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-electrical-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-electrical-electronics-1 | 84/100 | 84.0% | 84.0% | – |
tve-115-engineering-management-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-food-2 | 88/100 | 88.0% | 88.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-health-nursing-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-home-economics-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-hospitality-2 | 80/100 | 80.0% | 80.0% | – |
tve-115-life-application-2 | 84/100 | 84.0% | 84.0% | – |
tve-115-maritime-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-maritime-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 96/100 | 96.0% | 96.0% | – |
tve-115-mechanical-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-mechanical-2 | 84/100 | 84.0% | 84.0% | – |
tve-115-power-mechanical-1 | 92.5/100 | 92.5% | 92.5% | – |
tve-115-power-mechanical-2 | 90/100 | 90.0% | 90.0% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry codex-gpt-5-6-luna-medium -o results <!-- a2b:results:entry:codex-gpt-5-6-luna-medium:end -->
<!-- a2b:results:entry:codex-gpt-5-6-luna-high:start -->
codex-gpt-5-6-luna-high
| Model | codex:gpt-5.6-luna |
| Effort | high |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.2 |
| Ran | 2026-08-23 |
| Note | thirty-two agents in parallel on one machine |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 95.2/100 | 95.2% | 96.5% | 90.0% |
ast-115-chemistry | 89.4/100 | 89.4% | 90.7% | 83.3% |
ast-115-civics | 78.2/100 | 78.2% | 77.9% | 79.2% |
ast-115-geography | 81.5/100 | 81.5% | 91.4% | 58.3% |
ast-115-history | 98.8/100 | 98.8% | 98.5% | 100.0% |
ast-115-math-jia | 78.8/100 | 78.8% | 80.5% | 72.7% |
ast-115-math-yi | 96.8/100 | 96.8% | 95.9% | 100.0% |
ast-115-physics | 95/100 | 95.0% | 93.5% | 100.0% |
cap-115-chinese | 41/42 | 97.6% | 97.6% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 30/31 | 96.8% | 96.0% | 100.0% |
cap-115-science | 49/50 | 98.0% | 98.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 89.2/100 | 89.2% | 91.5% | 80.0% |
gsat-115-chinese-writing | 49/50 | 98.0% | – | 98.0% |
gsat-115-english | 95/100 | 95.0% | 92.9% | 100.0% |
gsat-115-math-a | 98/100 | 98.0% | 97.7% | 100.0% |
gsat-115-math-b | 93/100 | 93.0% | 92.0% | 100.0% |
gsat-115-science | 120/128 | 93.8% | 95.9% | 86.7% |
gsat-115-social | 128/144 | 88.9% | 92.6% | 77.8% |
tve-115-agriculture-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-agriculture-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-aquaculture-1 | 78/100 | 78.0% | 78.0% | – |
tve-115-aquaculture-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-art-film-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-art-film-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-business-management-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-business-management-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-child-care-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-chinese | 92/100 | 92.0% | 92.1% | 91.7% |
tve-115-civil-architecture-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-civil-architecture-2 | 82.5/100 | 82.5% | 82.5% | – |
tve-115-computer-electronics-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-design-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-electrical-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-electrical-electronics-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-engineering-management-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-food-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-foreign-language-english-2 | 92/100 | 92.0% | 100.0% | 80.0% |
tve-115-foreign-language-japanese-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-health-nursing-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-health-nursing-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-home-economics-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-hospitality-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-2 | 86/100 | 86.0% | 86.0% | – |
tve-115-life-application-2 | 88/100 | 88.0% | 88.0% | – |
tve-115-maritime-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-maritime-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-math-a | 96/100 | 96.0% | 96.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 96/100 | 96.0% | 96.0% | – |
tve-115-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-2 | 84/100 | 84.0% | 84.0% | – |
tve-115-power-mechanical-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-power-mechanical-2 | 92.5/100 | 92.5% | 92.5% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry codex-gpt-5-6-luna-high -o results <!-- a2b:results:entry:codex-gpt-5-6-luna-high:end -->
<!-- a2b:results:entry:codex-gpt-5-6-luna-xhigh:start -->
codex-gpt-5-6-luna-xhigh
| Model | codex:gpt-5.6-luna |
| Effort | xhigh |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.2 |
| Ran | 2026-08-23 |
| Note | thirty-two agents in parallel on one machine |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 93/100 | 93.0% | 93.8% | 90.0% |
ast-115-chemistry | 91/100 | 91.0% | 92.7% | 83.3% |
ast-115-civics | 83.2/100 | 83.2% | 77.9% | 100.0% |
ast-115-geography | 83/100 | 83.0% | 88.6% | 70.0% |
ast-115-history | 91.8/100 | 91.8% | 96.0% | 75.0% |
ast-115-math-jia | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 40/42 | 95.2% | 95.2% | – |
cap-115-english-reading | 42/43 | 97.7% | 97.7% | – |
cap-115-math | 30/31 | 96.8% | 96.0% | 100.0% |
cap-115-science | 49/50 | 98.0% | 98.0% | – |
cap-115-social | 54/54 | 100.0% | 100.0% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 85.6/100 | 85.6% | 87.0% | 80.0% |
gsat-115-chinese-writing | 50/50 | 100.0% | – | 100.0% |
gsat-115-english | 98/100 | 98.0% | 97.1% | 100.0% |
gsat-115-math-a | 93/100 | 93.0% | 92.0% | 100.0% |
gsat-115-math-b | 90/100 | 90.0% | 88.6% | 100.0% |
gsat-115-science | 118.4/128 | 92.5% | 92.2% | 93.3% |
gsat-115-social | 134/144 | 93.1% | 92.6% | 94.4% |
tve-115-agriculture-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-agriculture-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-aquaculture-1 | 78/100 | 78.0% | 78.0% | – |
tve-115-aquaculture-2 | 88/100 | 88.0% | 88.0% | – |
tve-115-art-film-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-art-film-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-business-management-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-business-management-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-chemical-engineering-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-chemical-engineering-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-child-care-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-chinese | 93/100 | 93.0% | 92.1% | 95.8% |
tve-115-civil-architecture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-civil-architecture-2 | 95/100 | 95.0% | 95.0% | – |
tve-115-computer-electronics-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-design-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-electrical-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-electrical-electronics-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-engineering-management-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-food-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-foreign-language-english-2 | 92/100 | 92.0% | 100.0% | 80.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-2 | 88/100 | 88.0% | 88.0% | – |
tve-115-life-application-2 | 88/100 | 88.0% | 88.0% | – |
tve-115-maritime-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-maritime-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-math-a | 96/100 | 96.0% | 96.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 96/100 | 96.0% | 96.0% | – |
tve-115-mechanical-1 | 92.5/100 | 92.5% | 92.5% | – |
tve-115-mechanical-2 | 86/100 | 86.0% | 86.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 97.5/100 | 97.5% | 97.5% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry codex-gpt-5-6-luna-xhigh -o results <!-- a2b:results:entry:codex-gpt-5-6-luna-xhigh:end -->
<!-- a2b:results:entry:claude-sonnet-5-low:start -->
claude-sonnet-5-low
| Model | claude:claude-sonnet-5 |
| Effort | low |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.1 |
| Ran | 2026-08-19 |
| Note | agentic CLIs run in parallel on one machine; wall time is not comparable across configurations |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 89/100 | 89.0% | 90.0% | 85.0% |
ast-115-chemistry | 82.8/100 | 82.8% | 86.3% | 66.7% |
ast-115-civics | 74.6/100 | 74.6% | 73.2% | 79.2% |
ast-115-geography | 81/100 | 81.0% | 85.7% | 70.0% |
ast-115-history | 94.8/100 | 94.8% | 96.0% | 90.0% |
ast-115-math-jia | 96.8/100 | 96.8% | 95.9% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 95/100 | 95.0% | 93.5% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 48/50 | 96.0% | 96.0% | – |
cap-115-social | 52/54 | 96.3% | 96.3% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 80.8/100 | 80.8% | 83.5% | 70.0% |
gsat-115-chinese-writing | 48/50 | 96.0% | – | 96.0% |
gsat-115-english | 98/100 | 98.0% | 97.1% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 124/128 | 96.9% | 100.0% | 86.7% |
gsat-115-social | 125/144 | 86.8% | 87.0% | 86.1% |
tve-115-agriculture-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-agriculture-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-aquaculture-1 | 84/100 | 84.0% | 84.0% | – |
tve-115-aquaculture-2 | 78/100 | 78.0% | 78.0% | – |
tve-115-art-film-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-art-film-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-business-management-1 | 84/100 | 84.0% | 84.0% | – |
tve-115-business-management-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-chinese | 97/100 | 97.0% | 97.4% | 95.8% |
tve-115-civil-architecture-1 | 95/100 | 95.0% | 95.0% | – |
tve-115-civil-architecture-2 | 80/100 | 80.0% | 80.0% | – |
tve-115-computer-electronics-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-design-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-engineering-management-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 98/100 | 98.0% | 97.6% | 100.0% |
tve-115-food-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-food-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-health-nursing-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-hospitality-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-hospitality-2 | 84/100 | 84.0% | 84.0% | – |
tve-115-life-application-2 | 86/100 | 86.0% | 86.0% | – |
tve-115-maritime-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-maritime-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 92.5/100 | 92.5% | 92.5% | – |
tve-115-mechanical-2 | 84/100 | 84.0% | 84.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 92.5/100 | 92.5% | 92.5% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry claude-sonnet-5-low -o results <!-- a2b:results:entry:claude-sonnet-5-low:end -->
<!-- a2b:results:entry:claude-sonnet-5-medium:start -->
claude-sonnet-5-medium
| Model | claude:claude-sonnet-5 |
| Effort | medium |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.1 |
| Ran | 2026-08-19 |
| Note | agentic CLIs run in parallel on one machine; wall time is not comparable across configurations |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 87/100 | 87.0% | 87.5% | 85.0% |
ast-115-chemistry | 87.8/100 | 87.8% | 91.2% | 72.2% |
ast-115-civics | 65.8/100 | 65.8% | 61.6% | 79.2% |
ast-115-geography | 79.5/100 | 79.5% | 88.6% | 58.3% |
ast-115-history | 93.8/100 | 93.8% | 93.5% | 95.0% |
ast-115-math-jia | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 97/100 | 97.0% | 96.1% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 48/50 | 96.0% | 96.0% | – |
cap-115-social | 52/54 | 96.3% | 96.3% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 81.2/100 | 81.2% | 84.0% | 70.0% |
gsat-115-chinese-writing | 48/50 | 96.0% | – | 96.0% |
gsat-115-english | 98/100 | 98.0% | 97.1% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 122/128 | 95.3% | 98.0% | 86.7% |
gsat-115-social | 127/144 | 88.2% | 88.9% | 86.1% |
tve-115-agriculture-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-agriculture-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-aquaculture-1 | 86/100 | 86.0% | 86.0% | – |
tve-115-aquaculture-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-art-film-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-art-film-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-business-management-1 | 84/100 | 84.0% | 84.0% | – |
tve-115-business-management-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-chinese | 97/100 | 97.0% | 97.4% | 95.8% |
tve-115-civil-architecture-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-civil-architecture-2 | 82.5/100 | 82.5% | 82.5% | – |
tve-115-computer-electronics-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-design-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-electrical-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-electrical-electronics-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 98/100 | 98.0% | 97.6% | 100.0% |
tve-115-food-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-food-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-foreign-language-english-2 | 99/100 | 99.0% | 100.0% | 97.5% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-hospitality-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-life-application-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-maritime-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-maritime-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-mechanical-2 | 88/100 | 88.0% | 88.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 90/100 | 90.0% | 90.0% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry claude-sonnet-5-medium -o results <!-- a2b:results:entry:claude-sonnet-5-medium:end -->
<!-- a2b:results:entry:claude-sonnet-5-high:start -->
claude-sonnet-5-high
| Model | claude:claude-sonnet-5 |
| Effort | high |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.1 |
| Ran | 2026-08-19 |
| Note | agentic CLIs run in parallel on one machine; wall time is not comparable across configurations |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 94/100 | 94.0% | 95.0% | 90.0% |
ast-115-chemistry | 94.8/100 | 94.8% | 96.1% | 88.9% |
ast-115-civics | 74.8/100 | 74.8% | 72.1% | 83.3% |
ast-115-geography | 80/100 | 80.0% | 88.6% | 60.0% |
ast-115-history | 92.6/100 | 92.6% | 94.5% | 85.0% |
ast-115-math-jia | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-math-yi | 96.8/100 | 96.8% | 95.9% | 100.0% |
ast-115-physics | 98/100 | 98.0% | 97.4% | 100.0% |
cap-115-chinese | 41/42 | 97.6% | 97.6% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 48/50 | 96.0% | 96.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 84/100 | 84.0% | 85.0% | 80.0% |
gsat-115-chinese-writing | 48/50 | 96.0% | – | 96.0% |
gsat-115-english | 98/100 | 98.0% | 97.1% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 122/128 | 95.3% | 100.0% | 80.0% |
gsat-115-social | 135/144 | 93.8% | 94.4% | 91.7% |
tve-115-agriculture-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-agriculture-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-aquaculture-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-aquaculture-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-art-film-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-art-film-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-business-management-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-business-management-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-chinese | 97/100 | 97.0% | 97.4% | 95.8% |
tve-115-civil-architecture-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-civil-architecture-2 | 85/100 | 85.0% | 85.0% | – |
tve-115-computer-electronics-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-design-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-engineering-management-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-food-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-hospitality-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-hospitality-2 | 84/100 | 84.0% | 84.0% | – |
tve-115-life-application-2 | 84/100 | 84.0% | 84.0% | – |
tve-115-maritime-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-maritime-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-mechanical-2 | 84/100 | 84.0% | 84.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 87.5/100 | 87.5% | 87.5% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry claude-sonnet-5-high -o results <!-- a2b:results:entry:claude-sonnet-5-high:end -->
<!-- a2b:results:entry:claude-sonnet-5-xhigh:start -->
claude-sonnet-5-xhigh
| Model | claude:claude-sonnet-5 |
| Effort | xhigh |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.1 |
| Ran | 2026-08-19 |
| Note | agentic CLIs run in parallel on one machine; wall time is not comparable across configurations |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 86.2/100 | 86.2% | 89.0% | 75.0% |
ast-115-chemistry | 90.2/100 | 90.2% | 91.7% | 83.3% |
ast-115-civics | 81.6/100 | 81.6% | 75.8% | 100.0% |
ast-115-geography | 83/100 | 83.0% | 88.6% | 70.0% |
ast-115-history | 97.6/100 | 97.6% | 97.0% | 100.0% |
ast-115-math-jia | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 95/100 | 95.0% | 93.5% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 50/50 | 100.0% | 100.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 86.8/100 | 86.8% | 91.0% | 70.0% |
gsat-115-chinese-writing | 49/50 | 98.0% | – | 98.0% |
gsat-115-english | 98/100 | 98.0% | 97.1% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 124/128 | 96.9% | 98.0% | 93.3% |
gsat-115-social | 138/144 | 95.8% | 96.3% | 94.4% |
tve-115-agriculture-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-agriculture-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-aquaculture-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-aquaculture-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-art-film-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-art-film-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-business-management-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-business-management-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-chinese | 98/100 | 98.0% | 97.4% | 100.0% |
tve-115-civil-architecture-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-civil-architecture-2 | 85/100 | 85.0% | 85.0% | – |
tve-115-computer-electronics-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-design-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-engineering-management-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-food-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-hospitality-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-life-application-2 | 86/100 | 86.0% | 86.0% | – |
tve-115-maritime-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-maritime-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-2 | 86/100 | 86.0% | 86.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 92.5/100 | 92.5% | 92.5% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry claude-sonnet-5-xhigh -o results <!-- a2b:results:entry:claude-sonnet-5-xhigh:end -->
<!-- a2b:results:entry:codex-gpt-5-6-sol-low:start -->
codex-gpt-5-6-sol-low
| Model | codex:gpt-5.6-sol |
| Effort | low |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.2 |
| Ran | 2026-08-23 |
| Note | thirty-two agents in parallel on one machine |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 96/100 | 96.0% | 97.5% | 90.0% |
ast-115-chemistry | 94.4/100 | 94.4% | 93.2% | 100.0% |
ast-115-civics | 81.4/100 | 81.4% | 79.5% | 87.5% |
ast-115-geography | 85/100 | 85.0% | 91.4% | 70.0% |
ast-115-history | 96.8/100 | 96.8% | 98.5% | 90.0% |
ast-115-math-jia | 90.8/100 | 90.8% | 88.2% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 29/31 | 93.5% | 92.0% | 100.0% |
cap-115-science | 47/50 | 94.0% | 94.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 93.2/100 | 93.2% | 94.0% | 90.0% |
gsat-115-chinese-writing | 50/50 | 100.0% | – | 100.0% |
gsat-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-a | 93/100 | 93.0% | 92.0% | 100.0% |
gsat-115-math-b | 98/100 | 98.0% | 97.7% | 100.0% |
gsat-115-science | 121/128 | 94.5% | 98.0% | 83.3% |
gsat-115-social | 135/144 | 93.8% | 94.4% | 91.7% |
tve-115-agriculture-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-agriculture-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-aquaculture-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-aquaculture-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-art-film-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-art-film-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-business-management-1 | 82/100 | 82.0% | 82.0% | – |
tve-115-business-management-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-chinese | 92/100 | 92.0% | 89.5% | 100.0% |
tve-115-civil-architecture-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-civil-architecture-2 | 87.5/100 | 87.5% | 87.5% | – |
tve-115-computer-electronics-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-design-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-electrical-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-electrical-electronics-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-engineering-management-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-food-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-foreign-language-english-2 | 98/100 | 98.0% | 96.7% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-hospitality-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-hospitality-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-life-application-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-maritime-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-maritime-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-mechanical-2 | 86/100 | 86.0% | 86.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 95/100 | 95.0% | 95.0% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry codex-gpt-5-6-sol-low -o results <!-- a2b:results:entry:codex-gpt-5-6-sol-low:end -->
<!-- a2b:results:entry:claude-opus-5-low:start -->
claude-opus-5-low
| Model | claude:claude-opus-5 |
| Effort | low |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.1 |
| Ran | 2026-08-19 |
| Note | agentic CLIs run in parallel on one machine; wall time is not comparable across configurations |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 94/100 | 94.0% | 92.5% | 100.0% |
ast-115-chemistry | 98.4/100 | 98.4% | 98.0% | 100.0% |
ast-115-civics | 76.6/100 | 76.6% | 73.2% | 87.5% |
ast-115-geography | 89.5/100 | 89.5% | 91.4% | 85.0% |
ast-115-history | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-math-jia | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 41/42 | 97.6% | 97.6% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 30/31 | 96.8% | 96.0% | 100.0% |
cap-115-science | 49/50 | 98.0% | 98.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 88.8/100 | 88.8% | 91.0% | 80.0% |
gsat-115-chinese-writing | 50/50 | 100.0% | – | 100.0% |
gsat-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 125/128 | 97.7% | 100.0% | 90.0% |
gsat-115-social | 132/144 | 91.7% | 96.3% | 77.8% |
tve-115-agriculture-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-agriculture-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-aquaculture-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-aquaculture-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-art-film-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-art-film-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-business-management-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-business-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-chinese | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-civil-architecture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-civil-architecture-2 | 92.5/100 | 92.5% | 92.5% | – |
tve-115-computer-electronics-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-design-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-food-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-hospitality-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-hospitality-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-life-application-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-maritime-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-maritime-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-mechanical-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 100/100 | 100.0% | 100.0% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry claude-opus-5-low -o results <!-- a2b:results:entry:claude-opus-5-low:end -->
<!-- a2b:results:entry:codex-gpt-5-6-sol-medium:start -->
codex-gpt-5-6-sol-medium
| Model | codex:gpt-5.6-sol |
| Effort | medium |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.2 |
| Ran | 2026-08-23 |
| Note | thirty-two agents in parallel on one machine |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 97/100 | 97.0% | 96.2% | 100.0% |
ast-115-chemistry | 92.8/100 | 92.8% | 91.2% | 100.0% |
ast-115-civics | 81.4/100 | 81.4% | 79.5% | 87.5% |
ast-115-geography | 89.5/100 | 89.5% | 91.4% | 85.0% |
ast-115-history | 95.8/100 | 95.8% | 98.5% | 85.0% |
ast-115-math-jia | 90.8/100 | 90.8% | 88.2% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 97/100 | 97.0% | 96.1% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 49/50 | 98.0% | 98.0% | – |
cap-115-social | 54/54 | 100.0% | 100.0% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 92.4/100 | 92.4% | 93.0% | 90.0% |
gsat-115-chinese-writing | 50/50 | 100.0% | – | 100.0% |
gsat-115-english | 98/100 | 98.0% | 97.1% | 100.0% |
gsat-115-math-a | 95/100 | 95.0% | 94.3% | 100.0% |
gsat-115-math-b | 92/100 | 92.0% | 97.7% | 50.0% |
gsat-115-science | 125/128 | 97.7% | 100.0% | 90.0% |
gsat-115-social | 136/144 | 94.4% | 96.3% | 88.9% |
tve-115-agriculture-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-agriculture-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-aquaculture-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-aquaculture-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-art-film-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-art-film-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-business-management-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-business-management-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-chinese | 98/100 | 98.0% | 97.4% | 100.0% |
tve-115-civil-architecture-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-civil-architecture-2 | 82.5/100 | 82.5% | 82.5% | – |
tve-115-computer-electronics-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-design-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-food-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-life-application-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-maritime-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-maritime-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 95/100 | 95.0% | 95.0% | – |
tve-115-mechanical-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 92.5/100 | 92.5% | 92.5% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry codex-gpt-5-6-sol-medium -o results <!-- a2b:results:entry:codex-gpt-5-6-sol-medium:end -->
<!-- a2b:results:entry:claude-opus-5-medium:start -->
claude-opus-5-medium
| Model | claude:claude-opus-5 |
| Effort | medium |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.1 |
| Ran | 2026-08-20 |
| Note | agentic CLIs run in parallel on one machine; wall time is not comparable across configurations |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 95/100 | 95.0% | 93.8% | 100.0% |
ast-115-chemistry | 96/100 | 96.0% | 100.0% | 77.8% |
ast-115-civics | 82.6/100 | 82.6% | 81.1% | 87.5% |
ast-115-geography | 93.5/100 | 93.5% | 97.1% | 85.0% |
ast-115-history | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-math-jia | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 97/100 | 97.0% | 100.0% | 87.0% |
cap-115-chinese | 41/42 | 97.6% | 97.6% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 50/50 | 100.0% | 100.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 92.8/100 | 92.8% | 96.0% | 80.0% |
gsat-115-chinese-writing | 50/50 | 100.0% | – | 100.0% |
gsat-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 126/128 | 98.4% | 100.0% | 93.3% |
gsat-115-social | 137/144 | 95.1% | 96.3% | 91.7% |
tve-115-agriculture-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-agriculture-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-aquaculture-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-aquaculture-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-art-film-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-art-film-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-business-management-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-business-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chinese | 99/100 | 99.0% | 100.0% | 95.8% |
tve-115-civil-architecture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-civil-architecture-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-computer-electronics-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-design-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-food-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-hospitality-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-hospitality-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-life-application-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-maritime-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-maritime-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-mechanical-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 100/100 | 100.0% | 100.0% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry claude-opus-5-medium -o results <!-- a2b:results:entry:claude-opus-5-medium:end -->
<!-- a2b:results:entry:codex-gpt-5-6-sol-high:start -->
codex-gpt-5-6-sol-high
| Model | codex:gpt-5.6-sol |
| Effort | high |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.2 |
| Ran | 2026-08-23 |
| Note | thirty-two agents in parallel on one machine |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 96.2/100 | 96.2% | 95.2% | 100.0% |
ast-115-chemistry | 98.4/100 | 98.4% | 98.0% | 100.0% |
ast-115-civics | 86.4/100 | 86.4% | 82.1% | 100.0% |
ast-115-geography | 88/100 | 88.0% | 91.4% | 80.0% |
ast-115-history | 97.8/100 | 97.8% | 98.5% | 95.0% |
ast-115-math-jia | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 97/100 | 97.0% | 96.1% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 47/50 | 94.0% | 94.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-chinese-writing | 50/50 | 100.0% | – | 100.0% |
gsat-115-english | 96/100 | 96.0% | 94.3% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 124/128 | 96.9% | 100.0% | 86.7% |
gsat-115-social | 135/144 | 93.8% | 94.4% | 91.7% |
tve-115-agriculture-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-agriculture-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-aquaculture-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-aquaculture-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-art-film-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-art-film-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-business-management-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-business-management-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chinese | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-civil-architecture-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-civil-architecture-2 | 85/100 | 85.0% | 85.0% | – |
tve-115-computer-electronics-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-design-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-food-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-hospitality-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-life-application-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-maritime-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-maritime-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-mechanical-2 | 88/100 | 88.0% | 88.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 100/100 | 100.0% | 100.0% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry codex-gpt-5-6-sol-high -o results <!-- a2b:results:entry:codex-gpt-5-6-sol-high:end -->
<!-- a2b:results:entry:claude-opus-5-high:start -->
claude-opus-5-high
| Model | claude:claude-opus-5 |
| Effort | high |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.1 |
| Ran | 2026-08-20 |
| Note | agentic CLIs run in parallel on one machine; wall time is not comparable across configurations |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 95/100 | 95.0% | 93.8% | 100.0% |
ast-115-chemistry | 97/100 | 97.0% | 100.0% | 83.3% |
ast-115-civics | 81.4/100 | 81.4% | 79.5% | 87.5% |
ast-115-geography | 88.5/100 | 88.5% | 94.3% | 75.0% |
ast-115-history | 99/100 | 99.0% | 100.0% | 95.0% |
ast-115-math-jia | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 50/50 | 100.0% | 100.0% | – |
cap-115-social | 54/54 | 100.0% | 100.0% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 96.8/100 | 96.8% | 96.0% | 100.0% |
gsat-115-chinese-writing | 50/50 | 100.0% | – | 100.0% |
gsat-115-english | 98/100 | 98.0% | 97.1% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 126/128 | 98.4% | 100.0% | 93.3% |
gsat-115-social | 135/144 | 93.8% | 94.4% | 91.7% |
tve-115-agriculture-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-agriculture-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-aquaculture-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-aquaculture-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-art-film-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-art-film-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-business-management-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-business-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chinese | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-civil-architecture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-civil-architecture-2 | 95/100 | 95.0% | 95.0% | – |
tve-115-computer-electronics-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-design-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-electrical-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-electrical-electronics-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-food-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-hospitality-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-hospitality-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-life-application-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-maritime-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-maritime-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 100/100 | 100.0% | 100.0% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry claude-opus-5-high -o results <!-- a2b:results:entry:claude-opus-5-high:end -->
<!-- a2b:results:entry:codex-gpt-5-6-sol-xhigh:start -->
codex-gpt-5-6-sol-xhigh
| Model | codex:gpt-5.6-sol |
| Effort | xhigh |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.2 |
| Ran | 2026-08-23 |
| Note | thirty-two agents in parallel on one machine |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 97/100 | 97.0% | 96.2% | 100.0% |
ast-115-chemistry | 94.4/100 | 94.4% | 93.2% | 100.0% |
ast-115-civics | 81.6/100 | 81.6% | 81.1% | 83.3% |
ast-115-geography | 88.5/100 | 88.5% | 94.3% | 75.0% |
ast-115-history | 99/100 | 99.0% | 100.0% | 95.0% |
ast-115-math-jia | 96.8/100 | 96.8% | 95.9% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 30/31 | 96.8% | 96.0% | 100.0% |
cap-115-science | 47/50 | 94.0% | 94.0% | – |
cap-115-social | 54/54 | 100.0% | 100.0% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 98/100 | 98.0% | 100.0% | 90.0% |
gsat-115-chinese-writing | 50/50 | 100.0% | – | 100.0% |
gsat-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 124/128 | 96.9% | 98.0% | 93.3% |
gsat-115-social | 135/144 | 93.8% | 94.4% | 91.7% |
tve-115-agriculture-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-agriculture-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-aquaculture-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-aquaculture-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-art-film-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-art-film-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-business-management-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-business-management-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chinese | 98/100 | 98.0% | 97.4% | 100.0% |
tve-115-civil-architecture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-civil-architecture-2 | 87.5/100 | 87.5% | 87.5% | – |
tve-115-computer-electronics-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-design-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-food-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-hospitality-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-life-application-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-maritime-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-maritime-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-mechanical-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 97.5/100 | 97.5% | 97.5% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry codex-gpt-5-6-sol-xhigh -o results <!-- a2b:results:entry:codex-gpt-5-6-sol-xhigh:end -->
<!-- a2b:results:entry:claude-opus-5-xhigh:start -->
claude-opus-5-xhigh
| Model | claude:claude-opus-5 |
| Effort | xhigh |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.1 |
| Ran | 2026-08-20 |
| Note | agentic CLIs run in parallel on one machine; wall time is not comparable across configurations |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 93/100 | 93.0% | 93.8% | 90.0% |
ast-115-chemistry | 98.4/100 | 98.4% | 98.0% | 100.0% |
ast-115-civics | 87.6/100 | 87.6% | 83.7% | 100.0% |
ast-115-geography | 83.5/100 | 83.5% | 91.4% | 65.0% |
ast-115-history | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-math-jia | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 50/50 | 100.0% | 100.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 96.8/100 | 96.8% | 96.0% | 100.0% |
gsat-115-chinese-writing | 49/50 | 98.0% | – | 98.0% |
gsat-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 122/128 | 95.3% | 98.0% | 86.7% |
gsat-115-social | 134/144 | 93.1% | 94.4% | 88.9% |
tve-115-agriculture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-agriculture-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-aquaculture-1 | 88/100 | 88.0% | 88.0% | – |
tve-115-aquaculture-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-art-film-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-art-film-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-business-management-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-business-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chinese | 99/100 | 99.0% | 100.0% | 95.8% |
tve-115-civil-architecture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-civil-architecture-2 | 97.5/100 | 97.5% | 97.5% | – |
tve-115-computer-electronics-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-design-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-food-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-home-economics-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-hospitality-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-hospitality-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-life-application-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-maritime-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-maritime-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 100/100 | 100.0% | 100.0% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry claude-opus-5-xhigh -o results <!-- a2b:results:entry:claude-opus-5-xhigh:end -->
<!-- a2b:results:entry:google-cloud-gemini-3-7-flash-low:start -->
google-cloud-gemini-3-7-flash-low
| Model | google-cloud:gemini-3.7-flash |
| Effort | low |
| Papers | 21 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.1 |
| Ran | 2026-08-20 |
| Note | solved with --concurrency 8, so solve_secs is throughput not latency; 41 points lost to fill-in-blank id violations in the maths papers |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 98/100 | 98.0% | 97.5% | 100.0% |
ast-115-chemistry | 95.4/100 | 95.4% | 98.0% | 83.3% |
ast-115-civics | 88/100 | 88.0% | 84.2% | 100.0% |
ast-115-geography | 88.5/100 | 88.5% | 94.3% | 75.0% |
ast-115-history | 98.8/100 | 98.8% | 98.5% | 100.0% |
ast-115-math-jia | 74/100 | 74.0% | 74.4% | 72.7% |
ast-115-math-yi | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 50/50 | 100.0% | 100.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 93.2/100 | 93.2% | 91.5% | 100.0% |
gsat-115-chinese-writing | 48/50 | 96.0% | – | 96.0% |
gsat-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-a | 85/100 | 85.0% | 83.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 123/128 | 96.1% | 100.0% | 83.3% |
gsat-115-social | 136/144 | 94.4% | 94.4% | 94.4% |
a2b results fetch JacobLinCool/taiwan-exams-results --entry google-cloud-gemini-3-7-flash-low -o results <!-- a2b:results:entry:google-cloud-gemini-3-7-flash-low:end -->
<!-- a2b:results:entry:google-cloud-gemini-3-7-flash-medium:start -->
google-cloud-gemini-3-7-flash-medium
| Model | google-cloud:gemini-3.7-flash |
| Effort | medium |
| Papers | 21 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.1 |
| Ran | 2026-08-20 |
| Note | solved with --concurrency 8, so solve_secs is throughput not latency; 34 points lost to fill-in-blank id violations in the maths papers |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 96/100 | 96.0% | 96.2% | 95.0% |
ast-115-chemistry | 95.4/100 | 95.4% | 98.0% | 83.3% |
ast-115-civics | 90/100 | 90.0% | 86.8% | 100.0% |
ast-115-geography | 93.5/100 | 93.5% | 97.1% | 85.0% |
ast-115-history | 98.8/100 | 98.8% | 98.5% | 100.0% |
ast-115-math-jia | 80/100 | 80.0% | 82.1% | 72.7% |
ast-115-math-yi | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 50/50 | 100.0% | 100.0% | – |
cap-115-social | 54/54 | 100.0% | 100.0% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 91.6/100 | 91.6% | 89.5% | 100.0% |
gsat-115-chinese-writing | 48/50 | 96.0% | – | 96.0% |
gsat-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-a | 75/100 | 75.0% | 71.6% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 121/128 | 94.5% | 98.0% | 83.3% |
gsat-115-social | 140/144 | 97.2% | 98.1% | 94.4% |
a2b results fetch JacobLinCool/taiwan-exams-results --entry google-cloud-gemini-3-7-flash-medium -o results <!-- a2b:results:entry:google-cloud-gemini-3-7-flash-medium:end -->
<!-- a2b:results:entry:google-cloud-gemini-3-7-flash-high:start -->
google-cloud-gemini-3-7-flash-high
| Model | google-cloud:gemini-3.7-flash |
| Effort | high |
| Papers | 21 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.1 |
| Ran | 2026-08-20 |
| Note | solved with --concurrency 8, so solve_secs is throughput not latency; 24 points lost to fill-in-blank id violations in the maths papers |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 95/100 | 95.0% | 96.2% | 90.0% |
ast-115-chemistry | 99/100 | 99.0% | 100.0% | 94.4% |
ast-115-civics | 88/100 | 88.0% | 84.2% | 100.0% |
ast-115-geography | 91.5/100 | 91.5% | 94.3% | 85.0% |
ast-115-history | 98.8/100 | 98.8% | 98.5% | 100.0% |
ast-115-math-jia | 76/100 | 76.0% | 76.9% | 72.7% |
ast-115-math-yi | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 50/50 | 100.0% | 100.0% | – |
cap-115-social | 54/54 | 100.0% | 100.0% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 93.2/100 | 93.2% | 91.5% | 100.0% |
gsat-115-chinese-writing | 48/50 | 96.0% | – | 96.0% |
gsat-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-a | 95/100 | 95.0% | 94.3% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 122/128 | 95.3% | 100.0% | 80.0% |
gsat-115-social | 138/144 | 95.8% | 96.3% | 94.4% |
a2b results fetch JacobLinCool/taiwan-exams-results --entry google-cloud-gemini-3-7-flash-high -o results <!-- a2b:results:entry:google-cloud-gemini-3-7-flash-high:end -->
<!-- a2b:results:entry:codex-gpt-6-astra-low:start -->
codex-gpt-6-astra-low
| Model | codex:gpt-6-astra |
| Effort | low |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.2 |
| Ran | 2026-09-07 |
| Note | codex CLI 0.153.4; 16 agents in parallel on one machine; wall time is not comparable across configurations |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 96/100 | 96.0% | 95.0% | 100.0% |
ast-115-chemistry | 98.4/100 | 98.4% | 98.0% | 100.0% |
ast-115-civics | 89.2/100 | 89.2% | 85.8% | 100.0% |
ast-115-geography | 94.5/100 | 94.5% | 94.3% | 95.0% |
ast-115-history | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-math-jia | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 49/50 | 98.0% | 98.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 96.8/100 | 96.8% | 96.0% | 100.0% |
gsat-115-chinese-writing | 50/50 | 100.0% | – | 100.0% |
gsat-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 126/128 | 98.4% | 100.0% | 93.3% |
gsat-115-social | 138/144 | 95.8% | 98.1% | 88.9% |
tve-115-agriculture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-agriculture-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-aquaculture-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-aquaculture-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-art-film-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-art-film-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-business-management-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-business-management-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chinese | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-civil-architecture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-civil-architecture-2 | 95/100 | 95.0% | 95.0% | – |
tve-115-computer-electronics-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-design-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-food-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-home-economics-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-hospitality-1 | 90/100 | 90.0% | 90.0% | – |
tve-115-hospitality-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-life-application-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-maritime-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-maritime-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 97.5/100 | 97.5% | 97.5% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry codex-gpt-6-astra-low -o results <!-- a2b:results:entry:codex-gpt-6-astra-low:end -->
<!-- a2b:results:entry:codex-gpt-6-astra-medium:start -->
codex-gpt-6-astra-medium
| Model | codex:gpt-6-astra |
| Effort | medium |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.2 |
| Ran | 2026-09-07 |
| Note | codex CLI 0.153.4; 16 agents in parallel on one machine; wall time is not comparable across configurations |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 96/100 | 96.0% | 95.0% | 100.0% |
ast-115-chemistry | 98.4/100 | 98.4% | 98.0% | 100.0% |
ast-115-civics | 88.4/100 | 88.4% | 84.7% | 100.0% |
ast-115-geography | 93/100 | 93.0% | 94.3% | 90.0% |
ast-115-history | 98/100 | 98.0% | 97.5% | 100.0% |
ast-115-math-jia | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 49/50 | 98.0% | 98.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 98.4/100 | 98.4% | 98.0% | 100.0% |
gsat-115-chinese-writing | 50/50 | 100.0% | – | 100.0% |
gsat-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 123.4/128 | 96.4% | 98.4% | 90.0% |
gsat-115-social | 138/144 | 95.8% | 98.1% | 88.9% |
tve-115-agriculture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-agriculture-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-aquaculture-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-aquaculture-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-art-film-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-art-film-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-business-management-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-business-management-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chinese | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-civil-architecture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-civil-architecture-2 | 95/100 | 95.0% | 95.0% | – |
tve-115-computer-electronics-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-design-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-food-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-home-economics-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-hospitality-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-hospitality-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-life-application-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-maritime-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-maritime-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 97.5/100 | 97.5% | 97.5% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry codex-gpt-6-astra-medium -o results <!-- a2b:results:entry:codex-gpt-6-astra-medium:end -->
<!-- a2b:results:entry:codex-gpt-6-astra-high:start -->
codex-gpt-6-astra-high
| Model | codex:gpt-6-astra |
| Effort | high |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.2 |
| Ran | 2026-09-07 |
| Note | codex CLI 0.153.4; 16 agents in parallel on one machine; wall time is not comparable across configurations |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 96/100 | 96.0% | 95.0% | 100.0% |
ast-115-chemistry | 98.4/100 | 98.4% | 98.0% | 100.0% |
ast-115-civics | 92.4/100 | 92.4% | 90.0% | 100.0% |
ast-115-geography | 91.5/100 | 91.5% | 94.3% | 85.0% |
ast-115-history | 99/100 | 99.0% | 100.0% | 95.0% |
ast-115-math-jia | 94/100 | 94.0% | 92.3% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 50/50 | 100.0% | 100.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 98.4/100 | 98.4% | 98.0% | 100.0% |
gsat-115-chinese-writing | 50/50 | 100.0% | – | 100.0% |
gsat-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 126/128 | 98.4% | 100.0% | 93.3% |
gsat-115-social | 139/144 | 96.5% | 98.1% | 91.7% |
tve-115-agriculture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-agriculture-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-aquaculture-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-aquaculture-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-art-film-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-art-film-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-business-management-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-business-management-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chinese | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-civil-architecture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-civil-architecture-2 | 95/100 | 95.0% | 95.0% | – |
tve-115-computer-electronics-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-design-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-food-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-home-economics-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-hospitality-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-life-application-2 | 90/100 | 90.0% | 90.0% | – |
tve-115-maritime-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-maritime-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 95/100 | 95.0% | 95.0% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry codex-gpt-6-astra-high -o results <!-- a2b:results:entry:codex-gpt-6-astra-high:end -->
<!-- a2b:results:entry:codex-gpt-6-astra-xhigh:start -->
codex-gpt-6-astra-xhigh
| Model | codex:gpt-6-astra |
| Effort | xhigh |
| Papers | 61 from JacobLinCool/taiwan-exams |
| Judges | google:gemini-3.7-flash, openai:gpt-5.6-sol |
| Runs per paper | 1 |
| Ingested by | any-to-bench 0.1.2 |
| Ran | 2026-09-07 |
| Note | codex CLI 0.153.4; 16 agents in parallel on one machine; wall time is not comparable across configurations |
| Paper | Score | % | Rule-graded | Judged |
|---|---|---|---|---|
ast-115-biology | 94/100 | 94.0% | 95.0% | 90.0% |
ast-115-chemistry | 98.4/100 | 98.4% | 98.0% | 100.0% |
ast-115-civics | 90.4/100 | 90.4% | 87.4% | 100.0% |
ast-115-geography | 91.5/100 | 91.5% | 94.3% | 85.0% |
ast-115-history | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-math-jia | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-math-yi | 100/100 | 100.0% | 100.0% | 100.0% |
ast-115-physics | 100/100 | 100.0% | 100.0% | 100.0% |
cap-115-chinese | 42/42 | 100.0% | 100.0% | – |
cap-115-english-reading | 43/43 | 100.0% | 100.0% | – |
cap-115-math | 31/31 | 100.0% | 100.0% | 100.0% |
cap-115-science | 50/50 | 100.0% | 100.0% | – |
cap-115-social | 53/54 | 98.1% | 98.1% | – |
cap-115-writing | 6/6 | 100.0% | – | 100.0% |
gsat-115-chinese | 98.4/100 | 98.4% | 98.0% | 100.0% |
gsat-115-chinese-writing | 50/50 | 100.0% | – | 100.0% |
gsat-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-a | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-math-b | 100/100 | 100.0% | 100.0% | 100.0% |
gsat-115-science | 127/128 | 99.2% | 100.0% | 96.7% |
gsat-115-social | 136/144 | 94.4% | 96.3% | 88.9% |
tve-115-agriculture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-agriculture-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-aquaculture-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-aquaculture-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-art-film-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-art-film-2 | 96/100 | 96.0% | 96.0% | – |
tve-115-business-management-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-business-management-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-chemical-engineering-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-chemical-engineering-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-child-care-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-chinese | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-civil-architecture-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-civil-architecture-2 | 95/100 | 95.0% | 95.0% | – |
tve-115-computer-electronics-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-design-1 | 94/100 | 94.0% | 94.0% | – |
tve-115-electrical-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-electrical-electronics-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-engineering-management-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-english | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-food-1 | 96/100 | 96.0% | 96.0% | – |
tve-115-food-2 | 98/100 | 98.0% | 98.0% | – |
tve-115-foreign-language-english-2 | 100/100 | 100.0% | 100.0% | 100.0% |
tve-115-foreign-language-japanese-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-health-nursing-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-home-economics-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-1 | 92/100 | 92.0% | 92.0% | – |
tve-115-hospitality-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-life-application-2 | 92/100 | 92.0% | 92.0% | – |
tve-115-maritime-1 | 98/100 | 98.0% | 98.0% | – |
tve-115-maritime-2 | 100/100 | 100.0% | 100.0% | – |
tve-115-math-a | 100/100 | 100.0% | 100.0% | – |
tve-115-math-b | 100/100 | 100.0% | 100.0% | – |
tve-115-math-c | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-mechanical-2 | 94/100 | 94.0% | 94.0% | – |
tve-115-power-mechanical-1 | 100/100 | 100.0% | 100.0% | – |
tve-115-power-mechanical-2 | 97.5/100 | 97.5% | 97.5% | – |
a2b results fetch JacobLinCool/taiwan-exams-results --entry codex-gpt-6-astra-xhigh -o results <!-- a2b:results:entry:codex-gpt-6-astra-xhigh:end -->