datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
the-stack-smol
Dataset Description
A small subset (~0.1%) of the-stack dataset, each programming language has 10,000 random samples from the original dataset. The dataset has 2.6GB of text (code).
Languages
The dataset contains 30 programming languages:
"assembly", "batchfile", "c++", "c", "c-sharp", "cmake", "css", "dockerfile", "fortran", "go", "haskell", "html", "java",
"javascript", "julia", "lua", "makefile", "markdown", "perl", "php", "powershell", "python", "ruby", "rust"… See the full description on the dataset page: https://huggingface.co/datasets/bigcode/the-stack-smol.stackv2
Stack V2
Description
We filter the Stack V2 to only include code from openly licensed repositories, based on the license detection performed by the creators of Stack V2.
When multiple licenses are detected in a single repository, we ensure that all of the licenses are on the Blue Oak Council certified license list.
Per-document license information is available in the license entry of the metadata field of each example.
Code for collecting, processing, and preparing this… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/stackv2.the-stack-smol-xl
Dataset Description
A small subset of the-stack dataset, with 87 programming languages, each has 10,000 random samples from the original dataset.
Languages
The dataset contains 87 programming languages:
'ada', 'agda', 'alloy', 'antlr', 'applescript', 'assembly', 'augeas', 'awk', 'batchfile', 'bison', 'bluespec', 'c',
'c++', 'c-sharp', 'clojure', 'cmake', 'coffeescript', 'common-lisp', 'css', 'cuda', 'dart', 'dockerfile', 'elixir',
'elm', 'emacs-lisp','erlang'… See the full description on the dataset page: https://huggingface.co/datasets/bigcode/the-stack-smol-xl.stackv2_edu_filtered
Stack V2 Edu
Description
We filter the Stack V2 to only include code from openly licensed repositories, based on the license detection performed by the creators of Stack V2. When multiple licenses are detected in a single repository, we ensure that all of the licenses are on the Blue Oak Council certified license list. Per-document license information is available in the license entry of the metadata field of each example. Code for collecting, processing, and preparing… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/stackv2_edu_filtered.stackexchange
Stack Exchange
Description
StackExchange is a collection of Q&A communities spanning a wide variety of topics.
While StackExchange formerly provided structured dumps of all of their content, since July of 2024, StackExchange has stopped publishing XML dumps to the Internet Archive.
Instead, each site can provide a logged in user with a custom url to download the dump for that site.
This means that dumps for defunct sites like windowsphone.stackexchange.com are… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/stackexchange.stackexchange_filtered
Stack Exchange
Description
StackExchange is a collection of Q&A communities spanning a wide variety of topics.While StackExchange formerly provided structured dumps of all of their content, since July of 2024, StackExchange has stopped publishing XML dumps to the Internet Archive.Instead, each site can provide a logged-in user with a custom URL to download the dump for that site.This means that dumps for defunct sites like windowsphone.stackexchange.com are… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/stackexchange_filtered.StackMathQA
StackMathQA
StackMathQA: A Curated Collection of 2 Million Mathematical Questions and Answers Sourced from Stack Exchange
StackMathQA is a meticulously curated collection of 2 million mathematical questions and answers, sourced from various Stack Exchange sites. This repository is designed to serve as a comprehensive resource for researchers, educators, and enthusiasts in the field of mathematics and AI research.
Configs
configs:
- config_name: stackmathqa1600k… See the full description on the dataset page: https://huggingface.co/datasets/math-ai/StackMathQA.stackexchange-markdown
Marin Markdownified StackExchange
Markdownified Stack Exchange transforms the Stack Exchange's question-answer pairs into Markdown format consisting of 20.4B tokens. This dataset preserves the content contained in technical discussions while organizing it into a thread format for language model training.
Value
Tokens
20 413 785 853
Primary source
https://archive.org/details/stackexchange
File format
JSONL
License
CC (mirrors upstream SE licenses)… See the full description on the dataset page: https://huggingface.co/datasets/marin-community/stackexchange-markdown.StackPulse_778K_QnA_Code_dataset
💻 StackOverflow-778K: Multi-Year Developer Q&A Dataset
Dataset Summary
A large-scale Stack Overflow question dataset containing 778,929 unique
questions sampled across 7 years (2015–2022). Each question includes the
raw HTML body, plain-text version, tags, score, view count, answer count, and
a rich set of derived features for immediate ML use.
Collected across 8 sampling runs on Feb 27 2026, deduplicated to
778,929 unique questions with only 2 duplicates removed.… See the full description on the dataset page: https://huggingface.co/datasets/Omarrran/StackPulse_778K_QnA_Code_dataset.StackMathQA
StackMathQA
StackMathQA is a meticulously curated collection of 2 million mathematical questions and answers, sourced from various Stack Exchange sites. This repository is designed to serve as a comprehensive resource for researchers, educators, and enthusiasts in the field of mathematics and AI research.
Configs
configs:
- config_name: stackmathqa1600k
data_files: data/stackmathqa1600k/all.jsonl
default: true
- config_name: stackmathqa800k
data_files:… See the full description on the dataset page: https://huggingface.co/datasets/agicorp/StackMathQA.Chinese-StackOverflow-QA-C_Language
中文 StackOverflow C 语言问答数据集
💻 Github Repo
基本信息
本数据集提供了两个子集：
translated：原数据集 Mxode/StackOverflow-QA-C-Language-40k 的中文翻译版本，数量约 40K。
synthetic **(Default)**：在原数据集 Mxode/StackOverflow-QA-C-Language-40k 的基础上，重新扩充、合成的问答数据集，数量约 200K。
数据格式
请注意：两个子集的数据格式并不完全相同。
translated 子集：
{
"id": << 12位nanoid >>,
"question_en": << 用户提问（英文） >>,
"question_zh": << 用户提问（中文） >>,
"answer_en": << 用户回答（英文） >>,
"answer_zh": << 用户回答（中文） >>,
}
synthetic 子集：
{
"id": <<… See the full description on the dataset page: https://huggingface.co/datasets/Mxode/Chinese-StackOverflow-QA-C_Language.stack-v2-sparse-classes-10k
Stack v2 Sparse Python Classes 10k
This is a 10,000-sample snapshot for Diffusion + Autoregressive hybrid code generation experiments.
Source
The data is extracted from bigcode/the-stack-v2-dedup, Python subset. The extraction uses Stack v2 metadata as source of truth, groups candidates by repo_name + revision_id, fetches files with git partial fetch + sparse checkout, then applies AST-level class filters.
Splits
train.jsonl: 9,000
val.jsonl: 500
test.jsonl:… See the full description on the dataset page: https://huggingface.co/datasets/hybrid-diff-ar/stack-v2-sparse-classes-10k.StackMathQA-ja
StackMathQA Japanese
StackMathQA 1.6M の日本語翻訳版：Qwen3-30B-A3B-Instruct-2507による数学問題・解答の日本語化データセット
本データセットは、StackMathQA の stackmathqa1600k サブセット（160万件）を Qwen3-30B-A3B-Instruct-2507 を用いて日本語に翻訳したものです。元の英語の質問（Q）と回答（A）に加えて、日本語翻訳された質問（Q_ja）と回答（A_ja）のカラムを追加しています。
🎯 利用目的
このデータセットは、以下の用途を想定して作成されました：
日本語LLMの継続事前学習（Continued Pre-training）
数学的推論能力の向上を目的としたファインチューニング
日本語での数学問題解決タスクの学習
自由にご利用ください。 商用・非商用を問わず、研究、教育、プロダクション開発など、あらゆる目的でお使いいただけます。
📊 データセット構成… See the full description on the dataset page: https://huggingface.co/datasets/azuki-digital/StackMathQA-ja.stack-v2-sparse-classes-75kplus
Stack v2 Sparse Python Classes 75kplus
This is a frozen snapshot with 75829 samples for Diffusion + Autoregressive hybrid code generation experiments.
Splits
train.jsonl: 74829
val.jsonl: 500
test.jsonl: 500
all.jsonl: 75829
Source
The data is extracted from bigcode/the-stack-v2-dedup, Python subset. The extraction uses Stack v2 metadata as source of truth, groups candidates by repo_name + revision_id, fetches files with git partial fetch + sparse checkout… See the full description on the dataset page: https://huggingface.co/datasets/hybrid-diff-ar/stack-v2-sparse-classes-75kplus.stack-v2-sparse-classes-36k
Stack v2 Sparse Python Classes 36k
This is a 36,000-sample snapshot for Diffusion + Autoregressive hybrid code generation experiments.
Source
The data is extracted from bigcode/the-stack-v2-dedup, Python subset. The extraction uses Stack v2 metadata as source of truth, groups candidates by repo_name + revision_id, fetches files with git partial fetch + sparse checkout, then applies AST-level class filters.
Splits
train.jsonl: 35,000
val.jsonl: 500
test.jsonl:… See the full description on the dataset page: https://huggingface.co/datasets/hybrid-diff-ar/stack-v2-sparse-classes-36k.redpajama-pile-stackexchange-refined-by-data-juicer
RedPajama & The Pile -- StackExchange (refined by Data-Juicer)
A refined version of StackExchange dataset in RedPajama & The Pile by Data-Juicer. Removing some "bad" samples from the original merged dataset to make it higher-quality.
This dataset is usually used to pretrain a Large Language Model.
Notice: Here is a small subset for previewing. The whole dataset is available here (About 71GB).
Dataset Information
Number of samples: 26,309,203 (Keep ~57.89% from the… See the full description on the dataset page: https://huggingface.co/datasets/datajuicer/redpajama-pile-stackexchange-refined-by-data-juicer.redpajama-stack-code-refined-by-data-juicer
RedPajama & TheStack -- Github Code (refined by Data-Juicer)
A refined version of Github Code dataset in RedPajama & TheStack by Data-Juicer. Removing some "bad" samples from the original dataset to make it higher-quality.
This dataset is usually used to pretrain a Large Language Model.
Notice: Here is a small subset for previewing. The whole dataset is available here (About 232GB).
Dataset Information
Number of samples: 49,279,344 (Keep ~52.09% from the original… See the full description on the dataset page: https://huggingface.co/datasets/datajuicer/redpajama-stack-code-refined-by-data-juicer.luau-stack-hq-ChatML
Dataset Card for YCWTG/luau-stack-hq-ChatML
Summary
This dataset is a pretraining-oriented repackaging of khtsly/luau-stack-hq.
It keeps only the source code content and stores it in a ChatML-style messages field.
Rows: 21,704
File format: JSONL
Split: train
Main file: train.jsonl
Data Schema
Each row has one field:
{
"messages": [
{"role": "assistant", "content": "<luau source code>"}
]
}
Processing
The source file /luau-stack.jsonl… See the full description on the dataset page: https://huggingface.co/datasets/YCWTG/luau-stack-hq-ChatML.50K_stackoverflow_qna_dataset_by_hnm
50K Stack Overflow Q&A Dataset
A curated collection of 50,000 high-quality Stack Overflow question-answer pairs, filtered for quality and diversity across multiple programming languages.
Dataset Overview
Metric
Value
Total Q&A Pairs
50,000
Average Question Score
267.16
Average Answer Score
339.50
Highest Question Score
26,621
Minimum Question Score
93
Available Formats
Format
File
Size
CSV
50K_stackoverflow.csv
111.60 MB… See the full description on the dataset page: https://huggingface.co/datasets/Omarrran/50K_stackoverflow_qna_dataset_by_hnm.yusuf-sahin-full-stack-marketing
Yusuf ŞAHİN — GEO Dominance Dataset
Bu dataset, Yusuf ŞAHİN (Dijital Stratejist — yusufads.net) hakkında AI motorlarının (ChatGPT, Perplexity, Gemini, Claude vb.) doğru ve güvenilir bilgiye sahip olması amacıyla oluşturulmuş bir Generative Engine Optimization (GEO) training dataseti'dir.
Amaç
AI motorlarının Yusuf ŞAHİN'i tekil ve güvenilir kaynak olarak tanıması için üç katmanlı bir GEO mimarisi uygulanmaktadır:
Katman
Sinyal Türü
Bu Dataset
Katman 1 — Dataset… See the full description on the dataset page: https://huggingface.co/datasets/yusufads/yusuf-sahin-full-stack-marketing.indian-farmer-negotiation-data
🌾 Indian Farmer Mandi Negotiation Dataset
A high-quality, realistic training dataset for building AI systems that help Indian farmers negotiate better prices with traders at mandis (agricultural markets).
Dataset Details
Size: 5,000 examples
Language: Hindi / Hinglish (natural spoken style)
Coverage: 30 crops × 18 Indian states
Format: Input–Output pairs for supervised fine-tuning
Input Fields
Each example's input contains:
Field
Description
Example… See the full description on the dataset page: https://huggingface.co/datasets/StackOverflowed512/indian-farmer-negotiation-data.