ixprzemyslawpietrzak/octoagent-benchmarks-results
E2E v3 results (Hub splits) Layout baisbench_celltype (path prefix baisbench_celltype/) Prepared: datasets.load_dataset(repo, 'baisbench_celltype_prepared', split="task_type_N") Results: datasets.load_dataset(repo, 'baisbench_celltype', split="task_type_N") Layout baisbench_codex_gpt55 (path prefix baisbench_codex_gpt55/) Prepared: datasets.load_dataset(repo, 'baisbench_codex_gpt55_prepared', split="task_type_N") Results:… See the full description on the dataset page: https://huggingface.co/datasets/ixprzemyslawpietrzak/octoagent-benchmarks-results.
049
E2E v3 results (Hub splits)
Layout baisbench_celltype (path prefix baisbench_celltype/)
- Prepared:
datasets.load_dataset(repo, 'baisbench_celltype_prepared', split="task_type_N") - Results:
datasets.load_dataset(repo, 'baisbench_celltype', split="task_type_N")
Layout baisbench_codex_gpt55 (path prefix baisbench_codex_gpt55/)
- Prepared:
datasets.load_dataset(repo, 'baisbench_codex_gpt55_prepared', split="task_type_N") - Results:
datasets.load_dataset(repo, 'baisbench_codex_gpt55', split="task_type_N")
Layout baisbench_celltype_2 (path prefix baisbench_celltype_2/)
- Prepared:
datasets.load_dataset(repo, 'baisbench_celltype_2_prepared', split="task_type_N") - Results:
datasets.load_dataset(repo, 'baisbench_celltype_2', split="task_type_N")
Layout baisbench_claude_code_2 (path prefix baisbench_claude_code_2/)
- Prepared:
datasets.load_dataset(repo, 'baisbench_claude_code_2_prepared', split="task_type_N") - Results:
datasets.load_dataset(repo, 'baisbench_claude_code_2', split="task_type_N")
Layout baisbench_codex_gpt55_2 (path prefix baisbench_codex_gpt55_2/)
- Prepared:
datasets.load_dataset(repo, 'baisbench_codex_gpt55_2_prepared', split="task_type_N") - Results:
datasets.load_dataset(repo, 'baisbench_codex_gpt55_2', split="task_type_N")
Layout baisbench_celltype_3 (path prefix baisbench_celltype_3/)
- Prepared:
datasets.load_dataset(repo, 'baisbench_celltype_3_prepared', split="task_type_N") - Results:
datasets.load_dataset(repo, 'baisbench_celltype_3', split="task_type_N")
Layout baisbench_claude_code_3 (path prefix baisbench_claude_code_3/)
- Prepared:
datasets.load_dataset(repo, 'baisbench_claude_code_3_prepared', split="task_type_N") - Results:
datasets.load_dataset(repo, 'baisbench_claude_code_3', split="task_type_N")
Layout baisbench_codex_gpt55_3 (path prefix baisbench_codex_gpt55_3/)
- Prepared:
datasets.load_dataset(repo, 'baisbench_codex_gpt55_3_prepared', split="task_type_N") - Results:
datasets.load_dataset(repo, 'baisbench_codex_gpt55_3', split="task_type_N")
Prompt configurations
- `configs/baisbench_sd.yaml`
