datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
knows-benchmark
KNOWS Benchmark
KNOWS evaluates web agents on the work people actually do in Google Workspace: writing documents,
building spreadsheets, and composing slide decks that require web research, multi-step tool use, and
faithful grounding in retrieved sources.
This dataset contains the task definitions — the prompt an agent receives, plus the structured
evaluation rubric used to grade the artifact it produces.
Tasks
110 (22 templates × 5 instances)
Domains
20
Mean… See the full description on the dataset page: https://huggingface.co/datasets/utahnlp/knows-benchmark.know_sqlplease use the val ign file for training, its much cleaner. thanks :)
know-saraswati-cot
🚨 To all devs, scholars, and also fugazis of AI - A Philosophical Standpoint on AGI:
This is extraneous, if you have time to read it-- give it a shot. We stand at the precipice of a digital era where the notions of artificial intelligence are often muddled with the grandiose idea of Artificial General Intelligence (AGI). Here's a candid reflection:
Current LLMs and their Limitations: Let's be unequivocally clear—present-day language models, including transformers, are not a… See the full description on the dataset page: https://huggingface.co/datasets/knowrohit07/know-saraswati-cot.know-saraswati-alpaca-cot-by-knowrohitknow_sql_alpacaknow_sql_instructwhen-the-cot-knows-better
When the Chain of Thought Knows Better: Failure Modes in Multi-Turn Reasoning Models
Accepted at the ICML 2026 Workshop on Failure Modes in Agentic AI (FAGEN)
This repository contains the dataset for the paper When the Chain of Thought Knows Better: Failure Modes in Multi-Turn Reasoning Models.
Dataset Summary
This dataset contains the evaluation artifacts for the paper "When the Chain of Thought Knows Better: Failure Modes in Multi-Turn Reasoning Models". It… See the full description on the dataset page: https://huggingface.co/datasets/UVSKKR/when-the-cot-knows-better.know-saraswati-alpaca-cot-by-knowrohit_stringified-jsonifize