datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
witSignLanguage_MiniProjectDataset used for training a model to classify Danish Sign Language signs, based on MediaPipe hand landmark data.
The data is not split into training, test and validation sets.
The dataset consist of four classes, 'unknown', 'hello', 'bye' and 'thanks'.
There are 30 datapoints for each class.
Each data point is 30 frames of data stored in individual Numpy files with x, y and z values for each hand landmark.
minigridvigil-jailbreak-all-MiniLM-L6-v2
Vigil: LLM Jailbreak all-MiniLM-L6-v2
Repo: github.com/deadbits/vigil-llm
Vigil is a Python framework and REST API for assessing Large Language Model (LLM) prompts against a set of scanners to detect prompt injections, jailbreaks, and other potentially risky inputs.
This repository contains all-MiniLM-L6-v2 embeddings for all "jailbreak" prompts used by Vigil.
You can use the parquet2vdb.py utility to load the embeddings in the Vigil chromadb instance, or use them in your own… See the full description on the dataset page: https://huggingface.co/datasets/deadbits/vigil-jailbreak-all-MiniLM-L6-v2.nuReasoning_mini
nuReasoning
Full dataset
Paper website
nuReasoning website
nuReasoning is a reasoning-centric multimodal autonomous driving dataset for evaluating and training end-to-end driving systems in long-tail real-world scenarios.
Each sample is built around a driving clip with synchronized multi-camera images, LiDAR data, ego state, object annotations, HD map, routing, and frame-level reasoning annotations.
Reasoning annotations are organized into three complementary fields:… See the full description on the dataset page: https://huggingface.co/datasets/qixuewei/nuReasoning_mini.reachy-mini-emotions-library
Reachy Mini Emotions Library
Curated emotion recordings for the Reachy Mini robot, maintained by
Pollen Robotics. Each move is a JSON trajectory (head pose, antennas,
body yaw, sampled over time) paired with an Opus audio track.
Motion is sampled at 50 Hz; audio is mono Ogg/Opus (decoded natively by
the robot). Requires reachy_mini ≥ v1.8.4 (its move loader resolves
non-.wav audio sidecars).
File layout
Files live at the root of the dataset, named <emotion>.json +… See the full description on the dataset page: https://huggingface.co/datasets/pollen-robotics/reachy-mini-emotions-library.YFCC100M_OpenAI_subsetThe YFCC100M is one of the largest publicly and freely useable multimedia collection, containing the metadata of around 99.2 million photos and 0.8 million videos from Flickr, all of which were shared under one of the various Creative Commons licenses.
This version is a subset defined in openai/CLIP.NOAH-mini
MOAH mini
The dataset prest here is a very samll sample of NOAH dataset.
In the original dataset each satellite image is ~650MB with 234,089 images present in 11 bands.
It is not feasible to upload the complete dataset.
A sample of the dataset across diffrent modalities can be seen in the figure below:
The diffrence between NOAH and NOAH mini is hilighted in the figure below.
Each subplot is a band of Landsat 8 in NOAH.
The region hilighted in red is the region available in NOAH… See the full description on the dataset page: https://huggingface.co/datasets/mutakabbirCarleton/NOAH-mini.mini-imagenet
Dataset Description
A mini version of ImageNet-1k with 100 of 1000 classes present.
Unlike some 'mini' variants this one includes the original images at their original sizes. Many such subsets downsample to 84x84 or other smaller resolutions.
Data Splits
Train
50000 samples from ImageNet-1k train split
Validation
10000 samples from ImageNet-1k train split
Test
5000 samples from ImageNet-1k validation split (all 50 samples per class)… See the full description on the dataset page: https://huggingface.co/datasets/timm/mini-imagenet.scannet_mini_val_set_suiteminimind_dataset
📌 数据介绍
Ⅰ Tokenizer
分词器可以粗略理解成 LLM 使用的一本“词典”，负责把自然语言映射成 token id，再把 token id 解码回文本；项目中也提供了train_tokenizer.py作为词表训练示例。不建议重新训练 tokenizer，因为词表和切分规则一旦变化，模型权重、数据格式、推理接口与社区生态的兼容性都会下降，也会削弱模型的传播性。同时，tokenizer 还会影响 PPL 这类按 token 统计的指标，因此跨 tokenizer 比较时，BPB（Bits Per Byte）往往更有参考价值，可参考这篇。
对 MiniMind 这类小模型来说，词表大小还会直接影响 embedding 层和输出层的参数占比，因此保持词表精简通常是更合适的取舍。
Tokenizer介绍
第三方强大的开源模型例如 Yi、Qwen2、ChatGLM、Mistral、Llama 3 的 tokenizer 词表长度如下：… See the full description on the dataset page: https://huggingface.co/datasets/jingyaogong/minimind_dataset.lighton-ms-marco-mini
ms-marco-mini
This dataset gathers very few samples from MS MARCO to provide an example of triplet-based / knowledge distillation dataset formatting.
triplet subset
The triplet file is all we need to fine-tune a model based on contrastive loss.
Columns: "query", "positive", "negative"
Column types: str, str, str
Examples:{
"query": "what are the liberal arts?",
"positive": 'liberal arts. 1. the academic course of instruction at a college intended to provide general… See the full description on the dataset page: https://huggingface.co/datasets/lightonai/lighton-ms-marco-mini.c4-10k-mini-tokenized-16-ctx-gelu-1l-testsfrodobots-mini-text-500g
FrodoBots-Mini-4K
~4,000 hours of real-world teleoperation data from Earth Rover Mini / Mini+ sidewalk robots,
driven by a global operator network across 29 countries. Each ride bundles synchronized camera video
(front, and rear when available), two-way audio, and time-aligned GPS, IMU, and
drive/control (DRV) streams.
Third public FrodoBots dataset, after
BitRobot/FrodoBots-2K and
BitRobot/Berkeley-FrodoBots-7K.
Like the 2K release it ships raw, unannotated per-ride folders —… See the full description on the dataset page: https://huggingface.co/datasets/Wolfie-Jr/frodobots-mini-text-500g.YuLan-Mini-Datasets
YuLan-Mini Datasets
🔥 Updated (April 11, 2025): For a clearer presentation of the information, see the table at this link: link.
This datasets contains:
Classified data using python-edu-scorer and fineweb-edu-classifier
Synthesized data (math, code, instruction, ...)
Retrieved data using math, code, and reasoninig-classifier
Notice
Since we have used BPE-Dropout, in order to ensure accuracy, the data we uploaded is tokenized.… See the full description on the dataset page: https://huggingface.co/datasets/yulan-team/YuLan-Mini-Datasets.Multi-SWE-bench_mini
👋 Overview
To make the benchmark more lightweight and minimize resource consumption, we have introduced the Multi-SWE-bench mini.
This version contains 400 instances, with 50 instances per language (Python, Java, TypeScript, JavaScript, Go, Rust, C, and C++). It covers a range of difficulty levels—easy, medium, and hard—ensuring a balanced and efficient evaluation across multiple languages without excessive resource usage.The leaderboard can be found at:… See the full description on the dataset page: https://huggingface.co/datasets/ByteDance-Seed/Multi-SWE-bench_mini.open-imagesKABR-mini-scene-raw-videos
Dataset Card for Kenyan Animal Behavior Recognition (KABR) Mini-Scene Raw Videos
Dataset Summary
This dataset is comprised of a collection of 10+ hours of drone videos focused on Kenyan wildlife that contains behaviors of giraffes, plains zebras, and Grevy's zebras.
Animals can be identified with bounding box coordinates provided, and behavior annotations can be recovered by linking the labels back to these bounding boxes from the mini-scene annotations provided in our… See the full description on the dataset page: https://huggingface.co/datasets/imageomics/KABR-mini-scene-raw-videos.Amelia42-Mini
Dataset Overview
The Amelia42-Mini dataset provides air traffic position reports for 42 major U.S. airports, including the following airports:
KATL (Hartsfield-Jackson Atlanta International Airport)
KBDL (Bradley International Airport)
KBOS (Boston Logan International Airport)
KBWI (Baltimore/Washington International Thurgood Marshall Airport)
KCLE (Cleveland Hopkins International Airport)
KCLT (Charlotte Douglas International Airport)
KDCA (Washington National Airport)
KDEN… See the full description on the dataset page: https://huggingface.co/datasets/AmeliaCMU/Amelia42-Mini.adni-mini
ADNI mini v1.3 — SynthSeg-masked
This is a local derivative of medarc/adni-mini-v1-3.
It preserves the v1.3-r2 row order, metadata columns, labels, image geometry,
and float32 values inside the brain. The only image change is:
image[synthseg_dseg == 0] = 0.0
The brain mask is therefore defined strictly as nonzero labels in the matching
SynthSeg discrete segmentation.
See comparison.json and per_scan_stats.csv for measured storage and mask
statistics. This derivative is not the… See the full description on the dataset page: https://huggingface.co/datasets/medarc/adni-mini.rag-mini-wikipediaIn this huggingface discussion you can share what you used the dataset for.
Derives from https://www.kaggle.com/datasets/rtatman/questionanswer-dataset?resource=download we generated our own subset using generate.py.
vlite7-mini-32m-dataset
ISAI - 이사이
I’m an independent developer building and maintaining AI projects on my own.
Everything from model development to server costs, datasets, and feature updates is managed personally.
Any support you can provide greatly helps keep this project running and allows for continuous improvements.
If you find this project helpful, please consider supporting my work. Thank you.
혼자서 AI 프로젝트를 개발하고 운영하고 있습니다.
모델 개발부터 데이터셋 준비, 서버 비용 감당, 기능 업데이트까지 모두 직접 진행하고 있습니다.
보내주시는 따뜻한 후원은 안정적인… See the full description on the dataset page: https://huggingface.co/datasets/aixk/vlite7-mini-32m-dataset.minipile
Dataset Card for MiniPile
Dataset Description
The MiniPile Challenge for Data-Efficient Language Models
Dataset Summary
MiniPile is a 6GB subset of the deduplicated The Pile corpus. To curate MiniPile, we perform a simple, three-step data filtering process: we (1) infer embeddings for all documents of the Pile, (2) cluster the embedding space using k-means, and (3) filter out low-quality clusters.
The primary motivation for curating MiniPile is that (i) diverse… See the full description on the dataset page: https://huggingface.co/datasets/JeanKaddour/minipile.SWE-smith-mini_swe_agent_plus-trajectories-66k
Dataset: SWE-smith-mini_swe_agent_plus-trajectories-66k
A corpus of ~66k issue-solving trajectories collected with mini-swe-agent-plus on issues derived from SWE-smith. Each trajectory records the agent’s end-to-end process.
We training the Qwen3-8B model on different sizes of the training data. The results are shown in the figure, it could be observed that the solve rate on SWE-bench Verified improves approximately linearly with the logarithm of the data scale (1k → 66k… See the full description on the dataset page: https://huggingface.co/datasets/Kwai-Klear/SWE-smith-mini_swe_agent_plus-trajectories-66k.World-SimReady-Home-mini
WorldSimReady-Home-mini
A compact sample edition of WorldSimReady-Home, featuring simulation-ready home scenes for embodied AI research. It is intended for quick previews, scene-loading tests, and workflow validation.
Full dataset: WorldSimReady-Home
ModelScope mini: WorldSimReady-Home-mini
mini-VTAB
Mini-VTAB
A collection of VTAB (Visual Task Adaptation Benchmark) datasets. We sampled 1K training samples and 1K testing samples for each task.
Tasks
datasets = [
"caltech101",
"cifar10",
"cifar100",
"dtd",
"flowers",
"pets",
"sun397",
"svhn",
"pcam",
"eurosat",
"resisc45",
"diabetic_retinopathy",
"clevr_count_all",
"clevr_closest_object_distance",
"dmlab",
"dsprites_label_x_position"… See the full description on the dataset page: https://huggingface.co/datasets/antofuller/mini-VTAB.YuLan-Mini-Text-Datasets
News
[2025.04.11] Add dataset mixture: link.
[2025.03.30] Text datasets upload finished.
This is text dataset.
这是文本格式的数据集。
Since we have used BPE-Dropout, in order to ensure accuracy, you can find the tokenized dataset here.
由于我们使用了BPE-Dropout，为了保证准确性，你可以在这里找到分词后的数据。
For more information, please refer to our datasets details and preprocess details.
Contributing
We welcome any form of contribution, including feedback on model bad cases, feature suggestions, and example… See the full description on the dataset page: https://huggingface.co/datasets/yulan-team/YuLan-Mini-Text-Datasets.reachy-mini-wall-data
Reachy Mini — wall data (public)
posts.json for the Reachy Mini community wall: the AI-filtered posts shown publicly,
aggregated from Bluesky, YouTube, LinkedIn, TikTok, X and Reddit by the social-wall pipeline.
Fetch it directly (CORS-enabled) from any static site:
const url = "https://huggingface.co/datasets/pollen-robotics/reachy-mini-wall-data/resolve/main/posts.json";
const posts = await (await fetch(url)).json();
Each item: id, platform, author, handle, avatar, text… See the full description on the dataset page: https://huggingface.co/datasets/pollen-robotics/reachy-mini-wall-data.bird_mini_dev
BIRD-SQL Mini-Dev
Update 2025-07-04
We are grateful for the valuable feedback from the community over the past year regarding BIRD Mini-Dev. Based on your suggestions, we have made significant updates to the BIRD Mini-Dev dataset.
For New Users
If you are new to BIRD Mini-Dev, you can download the complete databases and datasets using the following link:
Download BIRD Mini-Dev Complete Package
For Existing Users
If you have already downloaded the… See the full description on the dataset page: https://huggingface.co/datasets/birdsql/bird_mini_dev.swe-bench-verified-miniSWEBench-verified-mini is a subset of SWEBench-verified that uses 50 instead of 500 datapoints, requires 5GB instead of 130GB of storage and has approximately the same distribution of performance, test pass rates and difficulty as the original dataset.
You can find more details here: https://github.com/mariushobbhahn/make_swe_bench_verified_mini
If you use the Inspect implementation, you can merely switch the dataset: str = "princeton-nlp/SWE-bench_Verified", to dataset: str =… See the full description on the dataset page: https://huggingface.co/datasets/MariusHobbhahn/swe-bench-verified-mini.