datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
aya_evaluation_suite
Dataset Summary
Aya Evaluation Suite contains a total of 26,750 open-ended conversation-style prompts to evaluate multilingual open-ended generation quality.To strike a balance between language coverage and the quality that comes with human curation, we create an evaluation suite that includes:
human-curated examples in 7 languages (tur, eng, yor, arb, zho, por, tel) → aya-human-annotated.
machine-translations of handpicked examples into 101 languages → dolly-machine-translated.… See the full description on the dataset page: https://huggingface.co/datasets/CohereLabs/aya_evaluation_suite.qwen38-27b-fidelity-suite-v3
Qwen3.8-27B distribution-fidelity suite v3 (held-out, 181 x 2048)
The frozen evaluation suite and the captured hidden states that let anyone recompute or
contest the KL-divergence numbers published for
malaiwah/Qwen3.8-27B-K4 — without a
GPU, without downloading any model, and without trusting the publisher.
Scope, stated up front. The captures in this snapshot are the iteration-1 set:
malaiwah/Qwen3.8-27B-K4, unsloth/Qwen3.8-27B-NVFP4 and Qwen/Qwen3.8-27B-FP8 against
the BF16… See the full description on the dataset page: https://huggingface.co/datasets/malaiwah/qwen38-27b-fidelity-suite-v3.temiz-mC4
Dataset Card for Temiz mC4
Temiz mC4 is the cleaned version of CulturaX corpus' Turkish split.
This corpus is a part of large scale Turkish corpus Bella Turca. For more details about Bella Turca, please refer to the publication.
split
num instances
size
num of words
train
76.432.893
168GB
21.06B
Total
76.432.893
168GB
21.06B
This collection includes web text, crawled from internet for mC4 corpus. CulturaX is even refined version of mC4 with quality filtering and… See the full description on the dataset page: https://huggingface.co/datasets/turkish-nlp-suite/temiz-mC4.qwen38-27b-fidelity-suite-v5
Qwen3.8-27B fidelity suite v5 — evaluation inputs, the BF16 reference, and every per-shard report
This dataset exists because we deleted expensive artifacts once and had to remake them. Every
tree here is replayable input for a future candidate, not a finished result — the finished
results live as receipts in the research repo. Publishing the inputs means the next candidate
costs one download instead of a fresh BF16 capture, and it means anyone can check our numbers
without our… See the full description on the dataset page: https://huggingface.co/datasets/malaiwah/qwen38-27b-fidelity-suite-v5.temiz-OSCAR
Dataset Card for Temiz OSCAR
Temiz OSCAR is a corpora collection consisting of cleaned versions of original OSCAR corpora.
This collection is made up of four datasets: OSCAR-2019, OSCAR-2109, OSCAR-2201 and OSCAR-2301
This corpus is a part of large scale Turkish corpus Bella Turca. For more details about Bella Turca, please refer to the publication.
Dataset
num instances
size
num of words
OSCAR-2019
3.671.430
7.7G
976M
OSCAR-2109
8.472.809
18G
2.22B
OSCAR-2201… See the full description on the dataset page: https://huggingface.co/datasets/turkish-nlp-suite/temiz-OSCAR.Indic-Rag-Suite
🌏 Multilingual Indic RAG Suite
A comprehensive multilingual question-answering dataset covering 18 Indian languages with 21,439,886 total samples, designed for RAG (Retrieval-Augmented Generation) applications and multilingual NLP research.
🚀 Quick Start
from datasets import load_dataset
# Load specific language (recommended)
dataset = load_dataset("ai4bharat/Indic-Rag-Suite", "as")
train_data = dataset['train']
print(f"Loaded {len(train_data)} samples")
# Access… See the full description on the dataset page: https://huggingface.co/datasets/ai4bharat/Indic-Rag-Suite.Havadis
Dataset Card for Havadis
Havadis is a high quality and large Turkish news corpus, indeed the largest Turkish news corpus ever.
This corpus is scraped from online news sebsites and includes text from popular newspapers such as
CNN Türk
Habertürk
Hürriyet
Millyet
NTV
Posta
Sabah
Star
Sözcü
Takvim
. The instances are first crawled from the corresponding websites, then went throught an extensive cleaning process. We eliminated instances that are too short, too repetetive… See the full description on the dataset page: https://huggingface.co/datasets/turkish-nlp-suite/Havadis.ForumSohbetleri
Dataset Card for ForumSohbetleri
ForumSohbetleri a web forum tetx corpus for Turkish, indeed first large-scale Turkish forum text corpus.
This corpus is a part of large scale Turkish corpus Bella Turca. For more details about Bella Turca, please refer to the publication.
This collection is made up of several subsets, each subset is gathered from the corresponding forum website. Forum websites contains diverse topics, ladies only, tech, economics, life, relations and much more...… See the full description on the dataset page: https://huggingface.co/datasets/turkish-nlp-suite/ForumSohbetleri.salabs-stem-deep-reasoning-cot-v13
🧪 SALabs Multi-Domain STEM Deep Reasoning & Chain-of-Thought (CoT) Corpus (v13.0)
[!IMPORTANT]
💳 Click Here to Purchase Enterprise Commercial License ($2,500 USD) & Instant 31.7MB Master Archive DownloadInstant download of the full lossless master package containing all 1,816 JSONL reasoning records + 13 complete uncompressed text corpora (31.72 MB uncompressed total) + commercial license certificate.
🌟 Executive Summary
The SALabs STEM Deep Reasoning… See the full description on the dataset page: https://huggingface.co/datasets/suitai/salabs-stem-deep-reasoning-cot-v13.AkademikDerlem
Dataset Card for AkademikDerlem
AkademikDerlem is a scientific text corpus for Turkish, gathered from misc academical publication websites.
This corpus is a part of large scale Turkish corpus Bella Turca. For more details about Bella Turca, please refer to the publication.
This collection is made up of five datasets: Articles, Academic-Abstracts, Medical-Articles, Medical-Abstracts, and Bilkent-Writings. The Bilkent-Writings dataset comes from creative writings produced in the… See the full description on the dataset page: https://huggingface.co/datasets/turkish-nlp-suite/AkademikDerlem.InstrucTurca
InstrucTurca v1.0.0 is a diverse synthetic instruction tuning dataset crafted for instruction-tuning Turkish LLMs. The data is compiled data various English datasets and sources, such as code instructions, poems, summarized texts, medical texts, and more.
Dataset content
BI55/MedText
checkai/instruction-poems
garage-bAInd/Open-Platypus
Locutusque/ColumnedChatCombined
nampdn-ai/tiny-codes
Open-Orca/OpenOrca
pubmed_qa
TIGER-Lab/MathInstruct… See the full description on the dataset page: https://huggingface.co/datasets/turkish-nlp-suite/InstrucTurca.falsification-suite
Falsification Suite
Standalone Python scripts, one per claim, each attempting to falsify a specific claim
made in the accompanying research campaign documents. Published by
CatQualia. Author: Christopher Betances — catqualia.com.
This suite is replayable — here is the measured result
Most datasets assert that their contents were verified. This one lets you re-run the
verification, and publishes how much of it reproduces.
verify_ledger.py takes the accompanying… See the full description on the dataset page: https://huggingface.co/datasets/CatQualia/falsification-suite.r8-eval-suite-5bucket
⚠️ CRITICAL: Ollama Inference Flag Required for derived models
If you train or serve any Qwen3.5-9B-derived model from this lineage via Ollama,
you MUST pass "think": false in /api/chat requests for chat / instruction following / tool use.
The qwen3.5 RENDERER auto-injects <think> tags causing 25-46% empty-answer rates without this flag.
See dataset cudabenchmarktest/r9-research-framework/_OLLAMA_INFERENCE_WARNING.md for the full lesson learned.
R8/R9 Five-Bucket… See the full description on the dataset page: https://huggingface.co/datasets/cudabenchmarktest/r8-eval-suite-5bucket.rust-code-suite
NickIBrody/rust-code-suite
Rust Code Suite is a public raw Rust source corpus built from open-source repositories and selected historical git revisions.
Splits
train.jsonl
validation.jsonl
test.jsonl
Schema
{
"id": "owner/repo:path:chunk",
"text": "...",
"arch": "rust",
"syntax": "rust",
"kind": "rust-source",
"repo": "owner/repo",
"path": "src/lib.rs",
"license": "GPL-2.0",
"commit": "abcdef123456",
"source_url":… See the full description on the dataset page: https://huggingface.co/datasets/NickIBrody/rust-code-suite.assembly-code-suite
NickIBrody/assembly-code-suite
Assembly Code Suite is a public raw assembly corpus built from open-source repositories and selected historical git revisions.
Splits
train.jsonl
validation.jsonl
test.jsonl
Schema
{
"id": "owner/repo:path:chunk",
"text": "...",
"arch": "x86_64",
"syntax": "gas-att",
"kind": "handwritten",
"repo": "owner/repo",
"path": "arch/x86/lib/memcpy_64.S",
"license": "GPL-2.0",
"commit": "abcdef123456",
"source_url":… See the full description on the dataset page: https://huggingface.co/datasets/NickIBrody/assembly-code-suite.agentic-tool-use-suite-2026
⚡ Agentic Tool-Use & Function Calling Suite (2026 Edition)
🚀 The Definitive 2026 Training Suite for Function Calling, Model Context Protocol (MCP), and Autonomous Software Agents.
🌟 Dataset Overview
Standard open-source function-calling datasets are saturated with 10-line toy stubs, unhandled exceptions, and naive wrappers that cause models to crash under real production conditions.
The Agentic Tool-Use & Function Calling Suite (2026) enforces a Heavyweight… See the full description on the dataset page: https://huggingface.co/datasets/beatsprom/agentic-tool-use-suite-2026.tale_suite_trajectories
Text-Adventure Agent Trajectories
Anonymous for NeurIPS 2026 Evaluations and Benchmark Track.
Agent trajectory data from a text-adventure benchmark suite.
Leaderboard
Top agents ranked by average best normalized score per game across 122 games, each repeated over 5 seeds (610 total). Scores reflect the highest normalized score achieved at any point during each playthrough, not the final score.
Note: The released trajectory files include o1 runs, but o1 is omitted from… See the full description on the dataset page: https://huggingface.co/datasets/talesuite/tale_suite_trajectories.complete-2026-gen2-enterprise-ai-master-suite
👑 Complete 2026 Enterprise AI SFT/DPO Master Suite (100,000 Pairs)
The Definitive Multi-Domain Dataset Suite for Enterprise Model Alignment & Distillation
The Complete 2026 Enterprise AI Master Suite by BeatsProm is a unified multi-domain training suite uniting all 10 specialized Gen-2 datasets into an exhaustive corpus of 100,000 multi-turn SFT pairs and 25,000 DPO preference pairs.
Curated with the AST & Semantic Output Barrier, this suite completely isolates… See the full description on the dataset page: https://huggingface.co/datasets/beatsprom/complete-2026-gen2-enterprise-ai-master-suite.temiz-WikiA cleaned version of Turkish Wikipedia dataset. The soource is wikimedia/wikipedia repo.
The text is cleaned throughoutly, first of all we eliminated text that are shorter than a predetermined threshold of words and characters. Then we normalized with NFKC, cleaned some non-ASCII chars and normalized whitespaces.
autonomous-linux-kernel-ebpf-xdp-suite
⚡ Autonomous Linux Kernel, eBPF & XDP Programmable Dataplane Suite (2026)
A Production-Grade, Verifiable Synthetic Corpus for Training Autonomous Linux Kernel & eBPF Systems Agents
⚡ Overview & Industry Problem
Modern hyperscale cloud datacenters, bare-metal Kubernetes clusters, and low-latency financial trading nodes rely on in-kernel programmable dataplanes: eBPF, AF_XDP zero-copy rings, Traffic Control (TC) shapers, BPF LSM security hooks… See the full description on the dataset page: https://huggingface.co/datasets/beatsprom/autonomous-linux-kernel-ebpf-xdp-suite.coffeescript-code-suite
CoffeeScript Code Suite
CoffeeScript Code Suite is a public code dataset built from permissively licensed open-source CoffeeScript repositories. It is designed for three practical uses:
CoffeeScript domain adaptation and continued pretraining through raw_corpus examples.
CoffeeScript completion training through completion examples.
CoffeeScript and JavaScript translation training through coffee_to_js and js_to_coffee examples.
The dataset was assembled automatically from public… See the full description on the dataset page: https://huggingface.co/datasets/NickIBrody/coffeescript-code-suite.llm-benchmark-suite
Tokonomix LLM Benchmark Suite
Version 0.1 · 2026-07-27 · 36,799 runs · 256 models · 11 providers
Authors: Mes Kalkan (InterIP Networks BV) · Tokonomix Editorial Team
Live dashboards: https://tokonomix.ai
Methodology: https://tokonomix.ai/en/benchmarks/methodology
Data license: CC-BY-4.0 · Code excerpts: MIT
Abstract
Tokonomix is an independent, open benchmark platform that evaluates large language
models across six task categories (coding, reasoning, creative… See the full description on the dataset page: https://huggingface.co/datasets/tokonomix/llm-benchmark-suite.compliance_eu_ai_act_bafin_dora_suite_teaser
🚀 Compliance & Governance - EU AI Act & BaFin/DORA Technical Compliance Suite (Evaluation Teaser)
⚡ Official Free Evaluation Teaser (50 Verified Multi-Turn Scenarios)🏆 Get the Full Production Package (1,000 Samples) & Commercial EULA on Gumroad:👉 Compliance & Governance - EU AI Act & BaFin/DORA Technical Compliance Suite on Gumroad🏷️ Use coupon code LAUNCH20 for 20 € off at checkout!
📦 What is Inside the Full Production Package:
1,000 Verified FAANG v2.0… See the full description on the dataset page: https://huggingface.co/datasets/emgena/compliance_eu_ai_act_bafin_dora_suite_teaser.autonomous-cloud-gpu-slurm-serving-suite
⚡ Autonomous Cloud GPU Infrastructure, Slurm Orchestration & Distributed Serving Suite (2026)
A Production-Grade, Verifiable Synthetic Corpus for Training Autonomous AI Supercomputing & LLM Serving Agents
⚡ Overview & Industry Problem
Operating massive AI supercomputers (thousands of NVIDIA H100/H200 and Blackwell GPUs) requires coordinating Slurm cluster schedules, topology-aware NVLink cliques, NCCL AllReduce rings, RoCE v2 lossless fabrics… See the full description on the dataset page: https://huggingface.co/datasets/beatsprom/autonomous-cloud-gpu-slurm-serving-suite.stateless-mcp-agent-evaluation-suite-2026
⚡ Stateless Model Context Protocol (MCP 2026) & Agent Evaluation Suite
A Production-Grade Corpus & Evaluation Harness for Claude 5, GPT-6 Astra, and DeepSeek V4.1
⚡ Overview & Industry Problem
As of late 2026, autonomous agent engineering has superseded prompt engineering. Enterprises and developers rely on Stateless Model Context Protocol (MCP) to connect reasoning models (Claude 5 Fable, GPT-6 Astra, DeepSeek V4.1-Flash) to production backends.… See the full description on the dataset page: https://huggingface.co/datasets/beatsprom/stateless-mcp-agent-evaluation-suite-2026.lesson-bench-v1
LessonBench V1
A benchmark dataset for evaluating AI-generated STEM lessons against human-written references.
🔗 GitHub Repository: SuienS/lesson-bench-v1
📄 Research Paper: LessonBench-V1: A Benchmark Dataset for Evaluating AI Lesson Generation Agents
The dataset can be also accessed directly from Kaggle.
Overview
LessonBench provides paired (lesson plan, human-written lesson) samples across 240 STEM topics, designed to benchmark AI lesson generation systems.… See the full description on the dataset page: https://huggingface.co/datasets/SuienR/lesson-bench-v1.autonomous-db-internals-vector-search-suite
⚡ Autonomous Database Internals, Vector Search Engines & Distributed Storage Suite (2026)
A Production-Grade, Verifiable Synthetic Corpus for Training Autonomous Database Kernel & Vector Retrieval LLMs
💼 Get Full 12,500-Row Enterprise Suite on Gumroad →
Full 10,000 SFT + 2,500 DPO Rows • 254.6 MB Pre-Indexed SQLite DB • RLVR/GRPO Sandboxed Testbed • Commercial License
⚡ Overview & Industry Problem
Deploying autonomous AI… See the full description on the dataset page: https://huggingface.co/datasets/beatsprom/autonomous-db-internals-vector-search-suite.autonomous-llvm-mlir-compiler-suite
⚡ Autonomous Compiler Internals, LLVM & MLIR Architecture Suite (2026)
A Production-Grade, Verifiable Synthetic Corpus for Training Frontier Coding Models (Qwen 3.8, DeepSeek-V3, Llama 3.3)
⚡ Overview & Industry Problem
Modern deep learning accelerators, custom ASICs, and high-performance computing clusters demand specialized, autonomous compilation infrastructure: LLVM IR custom passes, SSA dominance frontiers, Chaitin-Briggs graph coloring… See the full description on the dataset page: https://huggingface.co/datasets/beatsprom/autonomous-llvm-mlir-compiler-suite.tale_suite_trajectories_downsampled
Text-Adventure Agent Trajectories
Anonymous for NeurIPS 2026 Evaluations and Benchmark Track.
Agent trajectory data from a text-adventure benchmark suite.
Note: Only top 10 model trajectories included for this downsampled repo
Leaderboard
Top agents ranked by average best normalized score per game across 122 games, each repeated over 5 seeds (610 total). Scores reflect the highest normalized score achieved at any point during each playthrough, not the final score.… See the full description on the dataset page: https://huggingface.co/datasets/talesuite/tale_suite_trajectories_downsampled.autonomous-gpu-kernel-triton-cuda-suite-2026
⚡ Autonomous GPU Kernel, Triton & CUDA Architecture Suite (2026)
A Production-Grade, Verifiable Synthetic Corpus for Training Frontier Coding Models (Qwen 3.8, DeepSeek-V3, Llama 3.3)
⚡ Overview & Industry Problem
Modern deep learning accelerators, custom ASICs, and high-performance computing clusters demand specialized, autonomous GPU kernel infrastructure: OpenAI Triton fused kernels, FlashAttention-3 forward/backward online softmax… See the full description on the dataset page: https://huggingface.co/datasets/beatsprom/autonomous-gpu-kernel-triton-cuda-suite-2026.