datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
backend-code-generator-dataset
Backend Code Generation Dataset
Dataset Description
This dataset contains examples for training AI models to generate backend application code. It includes descriptions of backend requirements paired with complete, functional code implementations across multiple frameworks and programming languages.
Dataset Summary
The Backend Code Generation Dataset is designed to train models that can generate complete backend applications from natural language descriptions.… See the full description on the dataset page: https://huggingface.co/datasets/Techta/backend-code-generator-dataset.Japanese-RAG-Generator-Benchmark
Japanese RAG Generator Benchmark: 日本語 RAG における Generator 評価ベンチマーク
Japanese RAG Generator Benchmark (J-RAGBench) は日本語RAGにおけるGeneratorに用いるLLMの評価データセットを提供する。
実運用時のRAGに求められる多様な評価カテゴリを同一条件下で評価可能であり、複数の評価カテゴリが同時に出現する問題が含まれるQAデータセットを人手および、補助的にOpenAI API(gpt-4.1-2025-04-14)を用いて構築した。
J-RAGBenchの評価カテゴリ
Integration: 2~3文書程度の複数の情報源から適切な根拠を抽出・統合して回答を導く
Reasoning: 抽出された情報を踏まえて多段階の推論や数値計算などを実行する
Logical: 質問・関連文書間での語彙や表現の差異を解釈し、適切な回答を導く
Table:… See the full description on the dataset page: https://huggingface.co/datasets/neoai-inc/Japanese-RAG-Generator-Benchmark.CoEdPilot-generatorsynthetic-manuscript-generator
Synthetic Manuscript Generator
Synthetic Indic manuscript folios (paper + palm-leaf backgrounds) for OCR
training. Three scripts are produced as separate subsets/configs:
devanagari — 100 folios (85/10/5)
modi — 100 folios (85/10/5)
sharada — 100 folios (85/10/5)
Layout
Each subset is structured as a Hugging Face imagefolder:
<subset>/
train/
0000.png 0000.md metadata.jsonl
...
validation/
...
test/
...
metadata.jsonl rows look like:… See the full description on the dataset page: https://huggingface.co/datasets/Sampada22/synthetic-manuscript-generator.fashion_model_generatorhazwaste-generator-category-thresholds
Hazardous waste generator categories — federal vs California vs Washington thresholds and obligations
Canonical, always-current version: https://referencesource.org/hazwaste-generator-category-thresholds/
Machine-readable: https://referencesource.org/hazwaste-generator-category-thresholds/data.json — this mirror is a point-in-time copy.
Last verified: 2026-08-11
Stale after: 2027-08-11 (past this date, prefer the canonical copy —
it re-verifies on a cadence this snapshot does… See the full description on the dataset page: https://huggingface.co/datasets/referencesource/hazwaste-generator-category-thresholds.hazardous-waste-generator-fees-by-state
US state hazardous waste generator annual fees by category
Canonical, always-current version: https://referencesource.org/hazardous-waste-generator-fees-by-state/
Machine-readable: https://referencesource.org/hazardous-waste-generator-fees-by-state/data.json — this mirror is a point-in-time copy.
Last verified: 2026-08-16
Stale after: 2027-08-16 (past this date, prefer the canonical copy —
it re-verifies on a cadence this snapshot does not)
Records: 29
State-by-state annual… See the full description on the dataset page: https://huggingface.co/datasets/referencesource/hazardous-waste-generator-fees-by-state.video-generator-ai-agent
Video Generator Agent Meta and Traffic Dataset in AI Agent Marketplace | AI Agent Directory | AI Agent Index from DeepNLP
This dataset is collected from AI Agent Marketplace Index and Directory at http://www.deepnlp.org, which contains AI Agents's meta information such as agent's name, website, description, as well as the monthly updated Web performance metrics, including Google,Bing average search ranking positions, Github Stars, Arxiv References, etc.
The dataset is helpful for AI… See the full description on the dataset page: https://huggingface.co/datasets/DeepNLP/video-generator-ai-agent.Multilingual-Code-Generator-copy
A mixture of datasets focused on Source/Intermediate Representation training for multilingual code generation.
For SCU CSEN346.
Sources:
UKPLab/SLTrans
bigcode/the-stack
allenai/peS2o
open-web-math/open-web-math
crispr-cas-atlas-generator
CRISPR-Cas Atlas – GENERator-ready Dataset
This dataset is a derived, preprocessed version of the CRISPR-Cas Atlas, formatted for causal language model fine-tuning with GENERator.
Source
Original dataset:CRISPR-Cas Atlas v1.0
Ruffolo et al., Design of highly functional genome editors by modeling the universe of CRISPR-Cas sequences, bioRxiv (2024)https://www.biorxiv.org/content/10.1101/2024.04.22.590591v1
Processing
Each CRISPR-Cas operon was converted into a… See the full description on the dataset page: https://huggingface.co/datasets/metaXu264/crispr-cas-atlas-generator.music-generator-ai-agent
Music Generator Agent Meta and Traffic Dataset in AI Agent Marketplace | AI Agent Directory | AI Agent Index from DeepNLP
This dataset is collected from AI Agent Marketplace Index and Directory at http://www.deepnlp.org, which contains AI Agents's meta information such as agent's name, website, description, as well as the monthly updated Web performance metrics, including Google,Bing average search ranking positions, Github Stars, Arxiv References, etc.
The dataset is helpful for AI… See the full description on the dataset page: https://huggingface.co/datasets/DeepNLP/music-generator-ai-agent.persona-driven-prompt-generatoradaption-excel-flowchart-generator
This dataset is a remastered version prepared using Adaption's Adaptive Data platform.
adaption-excel_flowchart_generator
This dataset contains instructions, sample data tables, and configuration settings for an Excel-based tool that automatically generates flowcharts using VBA macros. It includes step-by-step guides for installing the module, defining process steps with specific shape types and connectors, and customizing layout parameters. The content demonstrates how to… See the full description on the dataset page: https://huggingface.co/datasets/joduor/adaption-excel-flowchart-generator.generator-cas-ft-dataset-trainaudio-generator-ai-agent
Audio Generator Agent Meta and Traffic Dataset in AI Agent Marketplace | AI Agent Directory | AI Agent Index from DeepNLP
This dataset is collected from AI Agent Marketplace Index and Directory at http://www.deepnlp.org, which contains AI Agents's meta information such as agent's name, website, description, as well as the monthly updated Web performance metrics, including Google,Bing average search ranking positions, Github Stars, Arxiv References, etc.
The dataset is helpful for AI… See the full description on the dataset page: https://huggingface.co/datasets/DeepNLP/audio-generator-ai-agent.image-generator-ai-agent
Image Generator Agent Meta and Traffic Dataset in AI Agent Marketplace | AI Agent Directory | AI Agent Index from DeepNLP
This dataset is collected from AI Agent Marketplace Index and Directory at http://www.deepnlp.org, which contains AI Agents's meta information such as agent's name, website, description, as well as the monthly updated Web performance metrics, including Google,Bing average search ranking positions, Github Stars, Arxiv References, etc.
The dataset is helpful for AI… See the full description on the dataset page: https://huggingface.co/datasets/DeepNLP/image-generator-ai-agent.QA-Dataset-Generator
RAG Scientific QA Dataset (Generated)
Dataset Description
This dataset contains 711 high-quality Question-Answering pairs synthetically generated from ArXiv scientific papers. It is specifically designed to fine-tune Large Language Models (LLMs) for Retrieval-Augmented Generation (RAG) tasks.
Source Data: 200 ArXiv papers (Computer Science: AI, CL, LG, IR).
Generation Method: Generated using gpt-4o-mini with strict rules to prevent hallucination.
Language:… See the full description on the dataset page: https://huggingface.co/datasets/xunnhi/QA-Dataset-Generator.generator-cas-ft-dataset-validadaption-excel-flowchart-generator-v1
This dataset is a remastered version prepared using Adaption's Adaptive Data platform.
adaption-excel_flowchart_generator
This dataset contains instructions, sample data tables, and configuration settings for an Excel-based tool that automatically generates flowcharts using VBA macros. It includes step-by-step guides for installing the module, defining process steps with specific shape types and connectors, and customizing layout parameters. The content demonstrates how to… See the full description on the dataset page: https://huggingface.co/datasets/joduor/adaption-excel-flowchart-generator-v1.cognitive-question-generator-v1
Cognitive Question Generator Dataset
Dataset for fine-tuning an expert analysis and question generation model. Contains 5,637 prompt-response pairs capturing expert reasoning patterns for technology transactions and product counseling.
Dataset Description
This dataset was generated from the CognitiveTrainer platform's Mode 1 (Expert Analysis) system, capturing:
Initial scenario analysis
Claim validation with chain-of-trust
Multi-turn expert dialogue
Final synthesis… See the full description on the dataset page: https://huggingface.co/datasets/KevinKeller/cognitive-question-generator-v1.palette-generatorGeneratorXThis is a reasoning dataset created using Claude Opus 4.5 with a reasoning depth set to high. Some of these questions are from reedmayhew and the rest were generated.
The dataset is meant for creating distilled versions of Claude Opus 4.5 by fine-tuning already existing open-source LLMs.
Stats
Costs: $ 52.3 (USD)
Total tokens (input + output): 2.13 M
generator-cas-ft-dataset
GENERator Cas Fine-tuning Dataset
This dataset is designed for fine-tuning GENERator on CRISPR-Cas–related DNA sequences.
File
generator_cas_ft_dataset.jsonl
Format
Each line is a JSON object, typically containing:
input : DNA sequence (length multiple of 6 for 6-mer tokenizer)
output : DNA sequence (autoregressive target)
role : cas_protein / crispr / tracrRNA / spacer (if present)
source : CRISPR-Cas Atlas–derived
Usage
from datasets… See the full description on the dataset page: https://huggingface.co/datasets/metaXu264/generator-cas-ft-dataset.llm-reward-generator-huyen-quadcopter-sft-889llm-reward-generator-quadcopter-sft-v3-huyen-889
LLM Reward Generator Quadcopter SFT V3 Huyen 889 (Updated over V2)
Removed system messages
All dataset rows now contain only user and assistant messages. The system role has been removed from both SFT and DPO outputs.
Removed few-shot example from prompt
The <valid_example> code block that was previously included in the user prompt has been removed. The model now receives only the task description and tensor reference — no reference implementation… See the full description on the dataset page: https://huggingface.co/datasets/UPB-RAT-Lab/llm-reward-generator-quadcopter-sft-v3-huyen-889.TP-GeneratorVEX_Code_Generatorllm-reward-generator-huyen-quadcopter-dpo-111llm-reward-generator-quadcopter-sft-v2-huyen-889readme-generator-dataset