datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
telco-gaia
Telco-GAIA
A GAIA-style benchmark for AI agents operating over a real telecom operator's
website snapshot plus a synthetic customer database. 100 tasks across 7
categories: Pricing, Miscellaneous, Images, Web Archives, PDF, PDF Visual,
Database.
Agents read questions.json + environment.md, browse the local website
(:8080) and query the database API (:8081), and produce a GAIA-compatible
submission.json.
What's here
File
What… See the full description on the dataset page: https://huggingface.co/datasets/kaust-generative-ai/telco-gaia.squadv1_generative_answers_20kSQuAD v1 Dataset with generative answer field.
telco-gaia-groundtruth
Telco-GAIA — Ground Truth (gated)
Answers + gold reasoning steps for the 100 Telco-GAIA tasks, plus the scorer.
ground_truth.json — task_id, category, language, question, final_answer, answer_type, steps, tools
evaluate.py, answer_matching.py — GAIA-style exact-match scorer
Pair with the open dataset kaust-generative-ai/telco-gaia for the questions, website,
and harness.
python evaluate.py --submission submission.json --ground-truth ground_truth.json --output results.json