datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
eai-taxonomy-code-w-dclm
💻 EAI-Taxonomy Code w/ DCLM
🏆 Website | 🖥️ Code | 📖 Paper
A 564 billion token dataset of high-quality code curated from web data using taxonomy-based filtering.
🎯 Dataset Overview
This dataset is part of the Essential-Web project, which introduces a new paradigm for dataset curation using expressive metadata and simple semantic filters. Unlike traditional code datasets that require complex domain-specific pipelines, our approach leverages a 12-category taxonomy… See the full description on the dataset page: https://huggingface.co/datasets/EssentialAI/eai-taxonomy-code-w-dclm.itis-taxonomy-instruct-30k-v2-negatives
ITIS Taxonomy Instruction Dataset with Negative Samples
Overview
The ITIS Taxonomy Instruction Dataset with Negative Samples is a structured instruction-response dataset derived from the public domain Integrated Taxonomic Information System (ITIS) database.
It was designed for fine-tuning large language models on taxonomy-oriented tasks such as rank identification, lineage reconstruction, parent taxon retrieval, taxonomic validity checks, and common name mapping.… See the full description on the dataset page: https://huggingface.co/datasets/Jaymerry/itis-taxonomy-instruct-30k-v2-negatives.genre-taxonomy-sfw
Genre Taxonomy — SFW Split
The safe-for-work half of a two-part short-fiction genre taxonomy: 119,753 genre
entries / 197,509 labels (genre + subgenre names; no story text). The adult
companion split lives in the paired repo genre-taxonomy-nsfw.
Every label was screened by multi-round LLM judging (large single-pass scan, then
targeted re-judging rounds) under a double-pass agreement standard: a label is
only acted on when independent judging passes agree. Labels judged… See the full description on the dataset page: https://huggingface.co/datasets/baiango/genre-taxonomy-sfw.genre-taxonomy-nsfw
Genre Taxonomy — NSFW Split
Content advisory: this is a taxonomy of genre/subgenre labels (no prose),
but the labels denote adult, sexually explicit, and graphic-violence themes.
Intended for content-filtering, routing, and dataset-hygiene research.
The adult half of a two-part short-fiction genre taxonomy: 2,194 genre entries /
3,940 labels (genre + subgenre names; no story text). The safe-for-work companion
split lives in the paired repo genre-taxonomy-sfw.
Every label was… See the full description on the dataset page: https://huggingface.co/datasets/baiango/genre-taxonomy-nsfw.itis-taxonomy-instruct-30k
ITIS Taxonomy Instruction Dataset (30K)
This dataset has been superseded by the v2 release with negative and unknown samples.
Overview
The ITIS Taxonomy Instruction Dataset (30K) is a structured
instruction-response dataset derived from the public domain Integrated
Taxonomic Information System (ITIS) database.
It contains 30,000 instruction-output pairs designed for fine-tuning
large language models on taxonomic reasoning and biodiversity-related
tasks.
The… See the full description on the dataset page: https://huggingface.co/datasets/Jaymerry/itis-taxonomy-instruct-30k.TACTBench-Samples
TACTBench Demonstration Samples
This repository contains five full-context demonstration examples from
TACTBench. It does not contain the TACT training set or the remaining hidden
TACTBench evaluation set. The samples use the same full-history representation
as the benchmark evaluation and illustrate direct correction, error
explanation, guided revision, clarification checking, affective feedback, and
retry elicitation.
Data
data/demo.jsonl: five complete… See the full description on the dataset page: https://huggingface.co/datasets/Taxonomy-Aligned-Conversational-Tutor/TACTBench-Samples.