datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
python-text-copilot-training-instruct-ai-research-2024-02-03
Python Copilot Instructions on How to Code using Alpaca and Yaml
Training and test datasets for building coding multimodal models that understand how to use the open source GitHub projects for the Agora Open Source AI Research Lab:
Agora GitHub Organization
Agora Hugging Face
This dataset is the 2024-02-03 update for the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-text-copilot-training-instruct-ai-research-2024-02-03.python-text-copilot-training-instruct
Python Copilot Instructions on How to Code using Alpaca and Yaml
This dataset is a subset of the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details
Each row contains python code, either a class method or a global function, imported modules, base classes (if any), exceptions (ordered based off the code), returns (ordered based off the code), arguments (ordered based off the… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-text-copilot-training-instruct.python-text-training-instruct-ai
Python Copilot Instructions on How to Code using Alpaca and Yaml
Training and test datasets for building coding multimodal models that understand how to use the open source GitHub projects for the Agora Open Source AI Research Lab:
Agora GitHub Organization
Agora Hugging Face
This dataset is the 2024-02-03 update for the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details… See the full description on the dataset page: https://huggingface.co/datasets/DevShubham/python-text-training-instruct-ai.python-text-copilot-training-instruct-ai-research
Building an AI Copilot Dataset to help keep up with Leading AI Research
This is a specialized, instruction dataset for training python coding assistants on how to code from leading AI/ML open source repositories (2.3M coding samples).
This dataset is a subset of the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details
This dataset holds the latest coding changes from >1159… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-text-copilot-training-instruct-ai-research.python-text-copilot-training-instruct-ai-research-2024-02-10
Python Copilot Instructions on How to Code using Alpaca and Yaml
Training and test datasets for building coding multimodal models that understand how to use the open source GitHub projects for the multimodal Qwen AI project:
Qwen
Qwen Agent
Qwen VL Chat
Qwen Audio
This dataset is the 2024-02-10 update for the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details
Each row… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-text-copilot-training-instruct-ai-research-2024-02-10.python-text-copilot-training-instruct-ai-research-2024-02-11
Python Copilot Instructions on How to Code using Alpaca and Yaml
Training and test datasets for building coding multimodal models that understand how to use the open source GitHub projects for the Autogen and multimodal Qwen AI project:
Qwen
Qwen Agent
Qwen VL Chat
Qwen Audio
This dataset is the 2024-02-11 update for the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-text-copilot-training-instruct-ai-research-2024-02-11.python-text-copilot-training-instruct-ai-research-2024-01-27
Python Copilot Instructions on How to Code using Alpaca and Yaml
This dataset is the 2024-01-27 update for the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details
Each row contains python code, either a class method or a global function, imported modules, base classes (if any), exceptions (ordered based off the code), returns (ordered based off the code), arguments (ordered… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-text-copilot-training-instruct-ai-research-2024-01-27.EarthScience-Text-LLM-20K-90-10
EarthScience-Text-LLM-20K-90-10
This is a pure-text Earth-science corpus unified from three non-overlapping upstream datasets:
Ekimetrics/climateqa-ipcc-ipbes-reports-1.0: climate and IPCC/IPBES report chunks.
GeoGPT-Research-Project/GeoGPT-CoT-QA: geoscience question-answer reasoning.
gremlin97/RemoteSensingCorpus: remote-sensing and geospatial machine-learning text.
Files and Split
The previous preprocessing outputs were merged into a 23,098-record pool and… See the full description on the dataset page: https://huggingface.co/datasets/moTcream/EarthScience-Text-LLM-20K-90-10.jfk-files-text
National Archives JFK Files Text Dataset
This dataset contains extracted text from the JFK assassination records released by the National Archives. The dataset preserves the original directory structure from archive.gov while providing significant performance and storage benefits for data analysis, AI applications, and large-scale processing.
Dataset Structure
The dataset is structured with the following columns:
Column
Description
year
The release year of the… See the full description on the dataset page: https://huggingface.co/datasets/mysocratesnote/jfk-files-text.DomesticNames_AllStates_Text Domestic Names from the Federal Government's repository of official geographic names [CSV dataset]
This Dataset includes 980,065 geographic names as of September 10, 2023.
It is apparent that no currently released LLMs are pretrained on datasets with many of these geographic names (i.e., features), descriptions, and histories.
Example: feature_name: Abercrombie Gulch
GPT-3.5 responds "I'm not aware of a specific location called Abercrombie Gulch in my training data,..." when prompted… See the full description on the dataset page: https://huggingface.co/datasets/cellos/DomesticNames_AllStates_Text.MapEval-Textual
MapEval-Textual
MapEval-Textual is created using MapQaTor.
Usage
from datasets import load_dataset
# Load dataset
ds = load_dataset("MapEval/MapEval-Textual", name="benchmark")
# Generate better prompts
for item in ds["test"]:
# Start with a clear task description
prompt = (
"You are a highly intelligent assistant. "
"Based on the given context, answer the multiple-choice question by selecting the correct option.\n\n"
"Context:\n" +… See the full description on the dataset page: https://huggingface.co/datasets/MapEval/MapEval-Textual.Text2Space
Text2Space
Synthetic dataset of 20,000 spatial reasoning instances. Each instance pairs a natural-language description of a 2D layout with three ASCII renderings of the same scene and a query about the relative position of two objects. Designed to train and evaluate language and vision-language models on spatial reasoning.
Companion dataset for the paper Learning to Draw ASCII Improves Spatial Reasoning in Language Models (arXiv:2604.14641).
Quick Look
{… See the full description on the dataset page: https://huggingface.co/datasets/ShiyuanHuang/Text2Space.ru-wikipedia-100k-full-text-daily-stats-10-years
📚 Russian Wikipedia Top 100K: Full Text with Daily Pageviews
**Крупнейший открытый датасет русскоязычной Википедии с полными текстами статей и ежедневной статистикой просмотров за 10 лет. МГУ, ОТиПЛ, 2025**
📖 Описание
Этот датасет содержит 99,348 самых популярных статей русскоязычной Википедии, отобранных по совокупному количеству просмотров за последние 10 лет.
Для каждой статьи собраны полный текст с сохранением структуры, метаданные и детальная ежедневная… See the full description on the dataset page: https://huggingface.co/datasets/Mikimi/ru-wikipedia-100k-full-text-daily-stats-10-years.textbooks-qa-nepali
Textbook Question-Answering Dataset (Nepali)
This repository contains ShareGPT-style conversations generated by the Textbook QA agentic pipeline.
Splits
train: validated conversations with non-empty question, answer, and rephrased_text.
Usage
from datasets import load_dataset
ds = load_dataset("dineshkarki/textbooks-qa-nepali")
train = ds["train"]
Schema
train: each row contains:
id: unique string
conversations: list of 2 messages: human and gpt… See the full description on the dataset page: https://huggingface.co/datasets/dineshkarki/textbooks-qa-nepali.namuwiki-arknights-text-preview
⚠️ 이 데이터셋은 테스트 버전으로, 데이터 일관성이 보장되지 않습니다.
Namuwiki Arknights Text Dataset (preview)
이 데이터셋은 명일방주 - 나무위키 관련 문서에서 추출한 한국어 텍스트 데이터셋입니다.
version: v1.0
📅 데이터 생성일
2025/09/12
📊 데이터셋 통계
전체 데이터 수: 1,463
전체 문서 수: 47
평균 품질 점수: 2.06
📝 데이터 구조
각 샘플은 다음과 같은 필드를 포함합니다:
id(str): 고유 식별자
doc_id(str): 문서 ID
doc_title(str): 문서 제목
section_id(str): 섹션 ID
section_depth(int): 섹션 깊이
section_number(str): 섹션 번호
section_url(str): 섹션 URL
parent_id(str): 부모 섹션… See the full description on the dataset page: https://huggingface.co/datasets/alchemine/namuwiki-arknights-text-preview.ocr_textsMapEval-Textual
MapEval-Textual
MapEval-Textual is created using MapQaTor.
Usage
from datasets import load_dataset
# Load dataset
ds = load_dataset("MapEval/MapEval-Textual", name="benchmark")
# Generate better prompts
for item in ds["test"]:
# Start with a clear task description
prompt = (
"You are a highly intelligent assistant. "
"Based on the given context, answer the multiple-choice question by selecting the correct option.\n\n"
"Context:\n"… See the full description on the dataset page: https://huggingface.co/datasets/TankVincent/MapEval-Textual.