datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
stackoverflow-posts
StackOverflow Posts Markdown
Dataset Summary
This dataset contains all posts submitted to StackOverflow before the 14th of June 2023 formatted as Markdown text.
The dataset contains ~60 Million posts, totaling ~35GB in size and ~65 billion characters of text.
The data is sourced from Internet Archive StackExchange Data Dump.
Dataset Structure
Each record corresponds to one post of a particular type.
Original ordering from the data dump is not exactly preserved… See the full description on the dataset page: https://huggingface.co/datasets/mikex86/stackoverflow-posts.stackoverflow-posts
StackOverflow Posts Markdown
Dataset Summary
This dataset contains all posts submitted to StackOverflow before the 14th of June 2023 formatted as Markdown text.
The dataset contains ~60 Million posts, totaling ~35GB in size and ~65 billion characters of text.
The data is sourced from Internet Archive StackExchange Data Dump.
Dataset Structure
Each record corresponds to one post of a particular type.
Original ordering from the data dump is not exactly preserved… See the full description on the dataset page: https://huggingface.co/datasets/farida5gaber/stackoverflow-posts.stackoverflow-chat-dutch
Dataset Card for Stack Overflow Chat Dutch
Dataset Summary
This dataset contains 56,964 conversations between een AI assistant and a (fake) "Human" (generated) in Dutch, specifically in the domain of programming (Stack Overflow). They are translations of Baize's machine-generated answers to the Stack Overflow dataset.
☕ Want to help me out? Translating the data with the OpenAI API, and prompt testing, cost me 💸$133.60💸. If you like this dataset, please consider buying… See the full description on the dataset page: https://huggingface.co/datasets/BramVanroy/stackoverflow-chat-dutch.stackoverflow-questions-long
stackoverflow questions for text classification: 'long'
This is pacovaldez/stackoverflow-questions filtered for 1024 GPT2 tokens or more in title + body
https://huggingface.co/datasets/pacovaldez/stackoverflow-questions
stackoverflow-kubernetes-questionsThe purpose of this dataset is to provide the opportunity to perform any training, fine-tuning, etc. for any Language Model. In the 'data' folder, you will find the dataset in Parquet format, which is one of the formats used for these processes.
In case it may be useful for other purposes, I have also included the dataset in CSV format.
All data in this dataset were retrieved from the Stack Exchange network using the Stack Exchange Data explorer tool… See the full description on the dataset page: https://huggingface.co/datasets/mcipriano/stackoverflow-kubernetes-questions.Chinese-StackOverflow-QA-C_Language
中文 StackOverflow C 语言问答数据集
💻 Github Repo
基本信息
本数据集提供了两个子集：
translated：原数据集 Mxode/StackOverflow-QA-C-Language-40k 的中文翻译版本，数量约 40K。
synthetic **(Default)**：在原数据集 Mxode/StackOverflow-QA-C-Language-40k 的基础上，重新扩充、合成的问答数据集，数量约 200K。
数据格式
请注意：两个子集的数据格式并不完全相同。
translated 子集：
{
"id": << 12位nanoid >>,
"question_en": << 用户提问（英文） >>,
"question_zh": << 用户提问（中文） >>,
"answer_en": << 用户回答（英文） >>,
"answer_zh": << 用户回答（中文） >>,
}
synthetic 子集：
{
"id": <<… See the full description on the dataset page: https://huggingface.co/datasets/Mxode/Chinese-StackOverflow-QA-C_Language.ja-stackoverflow
ja-stackoverflow
日本語版 Stack Overflow の スタック・オーバーフロー のデータダンプ をもとにデータを加工し、質問文と回答文のペアになるように調整した QA データセット。
データ構造
投稿本文は html2text を使ってマークダウン化されています。その際、
コードブロックは ``` で囲まれるように変更されています。
画像 URL に base64 エンコードされた画像が含まれる場合、 [unk] に置き換えています。
default サブセット
id: 質問投稿の ID
question: 質問投稿
answers: 質問に対する回答投稿のリスト
accepted_answer_id: 質問者に選ばれた回答のID。null の可能性がある
popular_answer_id: もっともスコアが高かった回答のID。null の可能性がある
simple サブセット
default サブセットから、 question と answers… See the full description on the dataset page: https://huggingface.co/datasets/p1atdev/ja-stackoverflow.stackoverflow-ai-solvedUpdated 1/19/2024: More than doubled the number of answers to 1,469,201, with a higher percent of 4o-mini and gemini 1.5 pro.
A dataset which comprises of ai answers to 1,469,201 stackoverflow questions relating to Python.
The questions were extracted from this dataset.
All responses are directly python, no codeblocks or anything.
A total of 545,697,115 input and 253,110,685 output o200k_base tokens (gpt-4o/4o-mini).
Model
Value
gemini-1.5-pro-002
442,261
gpt-4o-mini-2024-07-18… See the full description on the dataset page: https://huggingface.co/datasets/tennisb/stackoverflow-ai-solved.50K_stackoverflow_qna_dataset_by_hnm
50K Stack Overflow Q&A Dataset
A curated collection of 50,000 high-quality Stack Overflow question-answer pairs, filtered for quality and diversity across multiple programming languages.
Dataset Overview
Metric
Value
Total Q&A Pairs
50,000
Average Question Score
267.16
Average Answer Score
339.50
Highest Question Score
26,621
Minimum Question Score
93
Available Formats
Format
File
Size
CSV
50K_stackoverflow.csv
111.60 MB… See the full description on the dataset page: https://huggingface.co/datasets/Omarrran/50K_stackoverflow_qna_dataset_by_hnm.indian-farmer-negotiation-data
🌾 Indian Farmer Mandi Negotiation Dataset
A high-quality, realistic training dataset for building AI systems that help Indian farmers negotiate better prices with traders at mandis (agricultural markets).
Dataset Details
Size: 5,000 examples
Language: Hindi / Hinglish (natural spoken style)
Coverage: 30 crops × 18 Indian states
Format: Input–Output pairs for supervised fine-tuning
Input Fields
Each example's input contains:
Field
Description
Example… See the full description on the dataset page: https://huggingface.co/datasets/StackOverflowed512/indian-farmer-negotiation-data.