Jack-Jieke-Wu/Paper-Writing-Exam
Paper-Writing Exam Paper-Writing-Exam is the runnable Harbor benchmark for evaluating agents that write complete scientific manuscripts from prepared research materials. The current immutable task release is v0.4.1 at 367bbf67ea05d0ec3d580e062aadf5636b45fc65, with 274 tasks. Related datasets Dataset What it contains When to use it Paper-Writing-Exam Runnable Harbor task trees Run or inspect a benchmark task Paper-Writing-Exam-Trials Sanitized agent… See the full description on the dataset page: https://huggingface.co/datasets/Jack-Jieke-Wu/Paper-Writing-Exam.
Add lifesci-paperrecon-short tasks (3 tasks) (part 2)
Add lifesci-paperrecon-short tasks (3 tasks)
Add phys-paperrecon-short tasks (9 tasks) (part 3)
Add phys-paperrecon-short tasks (9 tasks) (part 2)
Add phys-paperrecon-short tasks (9 tasks)
Add phys-paperrecon-short tasks (5 tasks) (part 2)
Add phys-paperrecon-short tasks (5 tasks)
lspr-0023 final: tables + acceptance + delivery
Re-upload lspr-0023 with extracted tables
Add lspr-0023 (PaperSmith re-implementation, arXiv:2601.02265, oracle=1 nop=0)
Remove misplaced PaperSmith upload
Restore original README.md
Add arXiv:2609.05249 paper-writing task (PaperSmith, oracle=1 nop=0)
docs: clarify task dataset relationships and v0.4.1 use
Document v0.4.1 LifeSci table repair
Remove stale LifeSci files superseded by v0.4.1 rebuild
Release v0.4.1 LifeSci table-material repair
Document v0.4.0 Hello World release
Release v0.4.0 Hello World smoke task
Use direct Harbor task fetch from Hugging Face
Use direct Hugging Face task fetch instructions
Disable incompatible Dataset Viewer and document direct task fetch
Document v0.3.1 private-file inventory
Document LifeSci-PaperRecon v0.3.1
Add LifeSci-PaperRecon short tasks (part 13)
Add LifeSci-PaperRecon short tasks (part 12)
Add LifeSci-PaperRecon short tasks (part 11)
Add LifeSci-PaperRecon short tasks (part 10)
Add LifeSci-PaperRecon short tasks (part 9)
Add LifeSci-PaperRecon short tasks (part 8)
Add LifeSci-PaperRecon short tasks (part 7)
Add LifeSci-PaperRecon short tasks (part 6)
Add LifeSci-PaperRecon short tasks (part 5)
Add LifeSci-PaperRecon short tasks (part 4)
Add LifeSci-PaperRecon short tasks (part 3)
Add LifeSci-PaperRecon short tasks (part 2)
Add LifeSci-PaperRecon short tasks
Release v0.3.0: document task-contract remediation (#20)
Release v0.3.0: PaperWritingBench task-contract remediation (#20) (1/1)
Release v0.3.0: repair PaperWritingBench task contracts (#20) (part 74)
Release v0.3.0: repair PaperWritingBench task contracts (#20) (part 73)
Release v0.3.0: repair PaperWritingBench task contracts (#20) (part 72)
Release v0.3.0: repair PaperWritingBench task contracts (#20) (part 71)
Release v0.3.0: repair PaperWritingBench task contracts (#20) (part 70)
Release v0.3.0: repair PaperWritingBench task contracts (#20) (part 69)
Release v0.3.0: repair PaperWritingBench task contracts (#20) (part 68)
Release v0.3.0: repair PaperWritingBench task contracts (#20) (part 67)
Release v0.3.0: repair PaperWritingBench task contracts (#20) (part 66)
Release v0.3.0: repair PaperWritingBench task contracts (#20) (part 65)
Release v0.3.0: repair PaperWritingBench task contracts (#20) (part 64)