datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
stackoverflow-posts
StackOverflow Posts Markdown
Dataset Summary
This dataset contains all posts submitted to StackOverflow before the 14th of June 2023 formatted as Markdown text.
The dataset contains ~60 Million posts, totaling ~35GB in size and ~65 billion characters of text.
The data is sourced from Internet Archive StackExchange Data Dump.
Dataset Structure
Each record corresponds to one post of a particular type.
Original ordering from the data dump is not exactly preserved… See the full description on the dataset page: https://huggingface.co/datasets/mikex86/stackoverflow-posts.stackoverflow-posts
StackOverflow Posts Markdown
Dataset Summary
This dataset contains all posts submitted to StackOverflow before the 14th of June 2023 formatted as Markdown text.
The dataset contains ~60 Million posts, totaling ~35GB in size and ~65 billion characters of text.
The data is sourced from Internet Archive StackExchange Data Dump.
Dataset Structure
Each record corresponds to one post of a particular type.
Original ordering from the data dump is not exactly preserved… See the full description on the dataset page: https://huggingface.co/datasets/farida5gaber/stackoverflow-posts.stackoverflow_python
Dataset Card for "stackoverflow_python"
Dataset Summary
This dataset comes originally from kaggle.
It was originally split into three tables (CSV files) (Questions, Answers, and Tags)
now merged into a single table. Each row corresponds to a pair (question-answer) and
their associated tags.
The dataset contains all questions asked between August 2, 2008 and Ocotober 19, 2016.
Supported Tasks and Leaderboards
This might be useful for open-domain… See the full description on the dataset page: https://huggingface.co/datasets/koutch/stackoverflow_python.stackoverflow_linux
Dataset Card for "stackoverflow_linux"
Dataset information:
Source: Stack Overflow
Category: Linux
Number of samples: 300
Train/Test split: 270/30
Quality: Data come from the top 1k most upvoted questions
Additional Information
License
All Stack Overflow user contributions are licensed under CC-BY-SA 3.0 with attribution required.
More Information needed
stackoverflowVQA-filteredstackoverflow-chat-dutch
Dataset Card for Stack Overflow Chat Dutch
Dataset Summary
This dataset contains 56,964 conversations between een AI assistant and a (fake) "Human" (generated) in Dutch, specifically in the domain of programming (Stack Overflow). They are translations of Baize's machine-generated answers to the Stack Overflow dataset.
☕ Want to help me out? Translating the data with the OpenAI API, and prompt testing, cost me 💸$133.60💸. If you like this dataset, please consider buying… See the full description on the dataset page: https://huggingface.co/datasets/BramVanroy/stackoverflow-chat-dutch.stackoverflow-kubernetes-questionsThe purpose of this dataset is to provide the opportunity to perform any training, fine-tuning, etc. for any Language Model. In the 'data' folder, you will find the dataset in Parquet format, which is one of the formats used for these processes.
In case it may be useful for other purposes, I have also included the dataset in CSV format.
All data in this dataset were retrieved from the Stack Exchange network using the Stack Exchange Data explorer tool… See the full description on the dataset page: https://huggingface.co/datasets/mcipriano/stackoverflow-kubernetes-questions.stackoverflowVQA
Dataset Card for "stackoverflowVQA"
More Information needed
ru_stackoverflow
Russian StackOverflow dataset
Description
Summary: Dataset of questions, answers, and comments from ru.stackoverflow.com.
Script: create_stackoverflow.py
Point of Contact: Ilya Gusev
Languages: The dataset is in Russian with some programming code.
Usage
Prerequisites:
pip install datasets zstandard jsonlines pysimdjson
Loading:
from datasets import load_dataset
dataset = load_dataset('IlyaGusev/ru_stackoverflow', split="train")
for example in dataset:… See the full description on the dataset page: https://huggingface.co/datasets/IlyaGusev/ru_stackoverflow.stackoverflowVQA-filtered-small
Dataset Card for "stackoverflowVQA-filtered-small"
More Information needed
StackOverflow-QA-C-Language-40kThis is a collection of ~40k QA's in C Language from StackOverflow. The data has been initially cleaned, and each response is with Accepted Answer.
All data is <1000 in length.
The questions and answers were organized into a one-line format. A sample format is shown below:
{
"question": "```\nFILE* file = fopen(some file)\n\npcap_t* pd = pcap_fopen_offline(file)\n\npcap_close(pd)\n\nfclose(file)\n```\n\nThis code occurs double free error.\n\nCould you explain about this happening?\n\nMy… See the full description on the dataset page: https://huggingface.co/datasets/Mxode/StackOverflow-QA-C-Language-40k.stackoverflow_q_and_a_sample
Description
GitHub repository: https://github.com/EshanJayasundara/Stackoverflow-Python-Q-and-A-Extractor.
GitHub repository contains the automated workflow for extracting the question and answer pairs from Stackoverflow.
This dataset contains the question-answer pairs extracted from Stackoverflow using Stack Exchange API v2.3 and used following endpoints,
/answers/{ids} GET
/questions GET
From 2020 January 1 to Today
1. Dataset description,
Contains only python… See the full description on the dataset page: https://huggingface.co/datasets/eshangj/stackoverflow_q_and_a_sample.ja-stackoverflow
ja-stackoverflow
日本語版 Stack Overflow の スタック・オーバーフロー のデータダンプ をもとにデータを加工し、質問文と回答文のペアになるように調整した QA データセット。
データ構造
投稿本文は html2text を使ってマークダウン化されています。その際、
コードブロックは ``` で囲まれるように変更されています。
画像 URL に base64 エンコードされた画像が含まれる場合、 [unk] に置き換えています。
default サブセット
id: 質問投稿の ID
question: 質問投稿
answers: 質問に対する回答投稿のリスト
accepted_answer_id: 質問者に選ばれた回答のID。null の可能性がある
popular_answer_id: もっともスコアが高かった回答のID。null の可能性がある
simple サブセット
default サブセットから、 question と answers… See the full description on the dataset page: https://huggingface.co/datasets/p1atdev/ja-stackoverflow.stackoverflow_python_preprocessed
Dataset Card for "stackoverflow_python_preprocessed"
This is a preprocessed version of the [stackoverflow_python] dataset.
Questions and answers were filtered to only include questions with more than 100 votes and answers with more than 5 votes.
The dataset has been converted from HTML to plain text and only includes the title, question, and answer columns.
Additional Information
License
All Stack Overflow user contributions are licensed under CC-BY-SA 3.0 with… See the full description on the dataset page: https://huggingface.co/datasets/KonradSzafer/stackoverflow_python_preprocessed.StackOverflow-QA-C-Language-5kPS: More data (40k) can be found here Mxode/StackOverflow-QA-C-Language-40k.
This is a collection of ~5000 QA's in C Language from StackOverflow. The data has been initially cleaned, and each response is with Accepted Answer.
All data is <500 in length.
The questions and answers were organized into a one-line format. A sample format is shown below:
{
"question": "```\nFILE* file = fopen(some file)\n\npcap_t* pd = pcap_fopen_offline(file)\n\npcap_close(pd)\n\nfclose(file)\n```\n\nThis… See the full description on the dataset page: https://huggingface.co/datasets/Mxode/StackOverflow-QA-C-Language-5k.StackOverflow-TP4-1M
Dataset Details
Dataset Description
TP4 is a comprehensive dataset containing a curated collection of questions and answers from Stack Overflow. Focused on the realms of Python programming, NumPy, Pandas, TensorFlow, and PyTorch, TP4 includes essential attributes such as question ID, title, question body, answer body, associated tags, and score. This dataset is designed to facilitate research, analysis, and exploration of inquiries and solutions within the Python and… See the full description on the dataset page: https://huggingface.co/datasets/Syed-Hasan-8503/StackOverflow-TP4-1M.stackoverflow-qa-dataset
StackOverflow Q&A Dataset
This dataset contains question-answer pairs extracted from StackOverflow via CommonCrawl.
Dataset Structure
Each example contains:
instruction: The question title
input: Additional question context (optional)
response: The highest-voted answer
metadata: Source URL, answer score, total answers
Usage
from datasets import load_dataset
dataset = load_dataset("json", data_files="stackoverflow_training_dataset.jsonl")
Generated using… See the full description on the dataset page: https://huggingface.co/datasets/varsunk/stackoverflow-qa-dataset.stack-overflow-q-and-a=