CoolFace
Datasetpublic

russki/agents-last-exam-data

Agents Last Exam — Task Input Data Input files (the materials each task hands to the agent at run start) for the Agents Last Exam (ALE) benchmark. Browsable per-task directory layout. The Agents Last Exam dataset family ALE is published as three companion HuggingFace datasets: Dataset Contents Access Task Card Metadata One row per task: titles, prompts, taxonomy, input-file descriptors Open Task Input Data The input/ files each task hands the agent at… See the full description on the dataset page: https://huggingface.co/datasets/russki/agents-last-exam-data.

sourceHugging Facecc-by-4.0updated 4mo agoView on Hugging Face
1likes482downloads
Dataset Card

Agents Last Exam — Task Input Data

Input files (the materials each task hands to the agent at run start) for the Agents Last Exam (ALE) benchmark. Browsable per-task directory layout.

The Agents Last Exam dataset family

ALE is published as three companion HuggingFace datasets:

DatasetContentsAccess
Task Card MetadataOne row per task: titles, prompts, taxonomy, input-file descriptorsOpen
Task Input DataThe input/ files each task hands the agent at run startOpen
Reference (Ground-Truth) DataThe reference/ outputs used to score runs⚠️ Gated (manual approval)

You are viewing: Task Input Data.

Layout

tasks/
  <task_id>/                # e.g. business_finance/taxform_4_1
    <variant>/              # variant name as defined in the source repo
      input/                # files the agent receives at task start
        ...

What's Included

Only the input/ subdirectory of each task variant. These are the materials the agent is given when a run begins.

What's Excluded

  • —reference/ — ground-truth outputs. Published separately in the gated reference repo (see the family table above) to protect benchmark integrity.
  • —software/ — large/licensed software fixtures.
  • —VM images and any internal artifacts.
russki/agents-last-exam-data · CoolFace