datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
variouscryptodata
variouscryptodata
Crypto market datasets collected as a by-product of our own research and
published so they are not lost. One sub-folder per dataset; each appended
nightly where collection is still running.
folder
what
coverage
cadence
polymarket_updown_orderbook/
Polymarket Up/Down (5m/15m) order books, 10 levels, BTC/ETH/SOL/XRP/DOGE/HYPE/BNB, with Binance spot reference
2026-05-24 → present
appended nightly (previous UTC day)
hyperliquid_trades/
Hyperliquid perp… See the full description on the dataset page: https://huggingface.co/datasets/Barthel/variouscryptodata.MOTOR
MOTOR — A Multimodal Dataset for Two-Wheeler Rider Behavior Understanding
Project Page | Paper | Code
MOTOR is the first large-scale, multi-view, multimodal resource dedicated to two-wheelers in dense, unstructured traffic. It comprises 1,629 annotated sequences (25+ hours of video data) collected from 16 riders and integrates synchronized front, rear, and helmet videos, rider eye-gaze from wearable trackers, on-road audio, and telemetry (GPS, accelerometer, gyroscope).… See the full description on the dataset page: https://huggingface.co/datasets/varunpaturkar/MOTOR.variant-effect-prediction
Updates
[2025-09-09] We have added ClinVar variant effect prediction results to the repository. The evaluation dataset was sourced from SongLab. The benchmark includes comparisons of GENERator against Evo2, NT, NT-v2, HyenaDNA, GPN-MSA, CADD, phyloP, and phastCons.
Abouts
The human reference genome data is sourced from the NCBI website.
We have applied minor formatting adjustments to the dataset to facilitate streamlined data analysis.
How to use
from datasets… See the full description on the dataset page: https://huggingface.co/datasets/GenerTeam/variant-effect-prediction.variant-benchmark
Variant Benchmark
This benchmark is designed to evaluate how effectively models leverage variant information across diverse biological contexts.
Unlike conventional genomic benchmarks that focus primarily on region classification, our approach extends to a broader range of variant-driven molecular processes.
Existing assessments, such as BEND and the Genomic Long-Range Benchmark (GLRB),
provide valuable insights into specific tasks like noncoding pathogenicity and tissue-specific… See the full description on the dataset page: https://huggingface.co/datasets/m42-health/variant-benchmark.variations-merge-test-4
Merged LeRobot Dataset
This dataset was created by merging multiple LeRobot datasets using the LeRobot merge tool.
Source Datasets
This merged dataset combines the following 2 datasets:
jackvial/koch_screwdriver_attach_orange_panel_rse14clean
jackvial/koch_screwdriver_attach_orange_panel_e125
Dataset Statistics
Total Episodes: 139
Total Frames: 26038
Robot Type: koch_screwdriver_follower
FPS: 30
Dataset Structure
meta/info.json:
{… See the full description on the dataset page: https://huggingface.co/datasets/jackvial/variations-merge-test-4.so101_stationary_vary_objThis dataset was created using my fork of LeRobot.
Joint calibration
Joint calibration for the featured SO-101 is on Github
Dataset Structure
meta/info.json:
ensembl_variations
Ensembl Variations (Parquet Format)
This dataset contains Ensembl human genetic variations converted to Parquet format for fast and efficient VCF annotation.
Usage
With Polars (Recommended)
import polars as pl
# Load variants for chromosome 21
df = pl.scan_parquet("hf://datasets/just-dna-seq/ensembl_variations/data/homo_sapiens-chr21.parquet")
# Filter variants by position
variants = df.filter(
(pl.col("POS") >= 10000000) & (pl.col("POS") <= 20000000)… See the full description on the dataset page: https://huggingface.co/datasets/just-dna-seq/ensembl_variations.amazon-c2-varied-rubrics
Amazon C2 varied-rubric distillation
This release exposes six balanced C2 SFT configurations: latent-state and non-diverse candidate panels at
K=1, K=2, and K=4 rubrics per retained reviewer. Each rubric-writer target is paired with one full-rubric
listwise judge target over the same variant's frozen 40-candidate panel. The K arms within a variant share one
reviewer cohort and are exact nested prefixes.
Config
Train rows
Validation
Test
Train reviewers… See the full description on the dataset page: https://huggingface.co/datasets/asingh15/amazon-c2-varied-rubrics.private_instagram
Dataset Card for "private_instagram"
More Information needed
pick_place_up_to_four_white_socks_varying_daylight_intensity_trainKT_insert_card_into_wallet_20260808_233122yellow_block_grasp_varyThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 100,
"total_frames": 28373,
"total_tasks": 1,
"total_videos": 200,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/yangfengzzz/yellow_block_grasp_vary.so101_stationary_vary_bothThis dataset was created using my fork of LeRobot.
Joint calibration
Joint calibration for the featured SO-101 is on Github
Dataset Structure
meta/info.json:
lego_pick_and_placeMultivariate_time_series_data_of_milling_processes_with_varying_tool_wear_and_machine_tools
Flattened version of the "Multivariate time series data of milling processes with varying tool wear and machine tools" dataset in the .parquet file format. Original dataset: https://doi.org/10.17632/zpxs87bjt8.3 and original paper: https://doi.org/10.1016/j.dib.2023.109574
Description
The presented dataset provides labeled, multivariate time series data of milling processes with varying tool wear and for varying machine tools. The width of the flank wear land VB… See the full description on the dataset page: https://huggingface.co/datasets/alpha-by-beta/Multivariate_time_series_data_of_milling_processes_with_varying_tool_wear_and_machine_tools.pick_place_up_to_four_white_socks_varying_daylight_intensityThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower",
"total_episodes": 51,
"total_frames": 90384,
"total_tasks": 1,
"total_videos": 51,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:51"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/bearlover365/pick_place_up_to_four_white_socks_varying_daylight_intensity.so101_moving_vary_bothThis dataset was created using my fork of LeRobot.
Joint calibration
Joint calibration for the featured SO-101 is on Github
Dataset Structure
meta/info.json:
libero_90_various_action_spacesso101-pen-to-bin-variable-positionsThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so101_follower_advanced",
"total_episodes": 61,
"total_frames": 21120,
"total_tasks": 1,
"total_videos": 183,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:61"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/augelu-tng/so101-pen-to-bin-variable-positions.rollout_dagger_groot_so101_mdrift_initfromfm_var_step55000_multi6_sync_0826_1348_20260826_134841This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/geonmin-kim/rollout_dagger_groot_so101_mdrift_initfromfm_var_step55000_multi6_sync_0826_1348_20260826_134841.main-liquid3-variant-a
main-liquid3 — Variant A
LeRobot v3.0 dataset containing the first segment of each retained episode from
maitf/main-liquid3.
The demonstrations use an SO-101 follower arm to pick up a cup containing water,
pour it over a pan, and place it on the table with the help of a stick. Variant A
contains every frame before the manually selected per-episode boundary; the
boundary frame itself belongs to Variant B.
Dataset summary
76 episodes and 106,360 frames
30 FPS
Two… See the full description on the dataset page: https://huggingface.co/datasets/maitf/main-liquid3-variant-a.main-liquid3-variant-b
main-liquid3 — Variant B
LeRobot v3.0 dataset containing the second segment of each retained episode from
maitf/main-liquid3.
The demonstrations use an SO-101 follower arm to pick up a cup containing water,
pour it over a pan, and place it on the table with the help of a stick. Variant B
starts at the manually selected boundary frame for each episode and continues to
the end of that episode.
Dataset summary
76 episodes and 78,297 frames
30 FPS
Two 640×480 RGB… See the full description on the dataset page: https://huggingface.co/datasets/maitf/main-liquid3-variant-b.jenga_spatial_vars_20250725v1This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "so100_follower",
"total_episodes": 4,
"total_frames": 1430,
"total_tasks": 1,
"total_videos": 8,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 30,
"splits": {
"train": "0:4"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/salhotra/jenga_spatial_vars_20250725v1.gaia-dr3-vari-classifier-definition
Gaia DR3 variability classifier definition
This reference table describes the classifier used for Gaia DR3 variability classification. ESA's DR3 release contains one row, for the nTransits:5+ classifier. The related vari_classifier_class_definition table describes its class vocabulary, while vari_classifier_result contains its per-source results.
Use
python -m venv .venv && .venv/bin/pip install datasets pyarrow
from datasets import load_dataset
classifier =… See the full description on the dataset page: https://huggingface.co/datasets/astro-legacy-archive/gaia-dr3-vari-classifier-definition.so101_moving_both_vary_objThis dataset was created using my fork of LeRobot.
Joint calibration
Joint calibration for the featured SO-101 is on Github
Dataset Structure
meta/info.json:
opc-sft-s2-annealing-ins3-python-precode0.5-cb-og0.1entire_OG_var3yolov8-baseline-mosaic-variants-runsfrazier_dataset_v2_object_variation_20260916_143913This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"fps": 30,
"features": {
"action": {
"dtype": "float32",
"names": [
"shoulder_pan.pos",
"shoulder_lift.pos",
"elbow_flex.pos",
"wrist_flex.pos",
"wrist_roll.pos",
"gripper.pos"
],
"shape": [
6… See the full description on the dataset page: https://huggingface.co/datasets/seriintan/frazier_dataset_v2_object_variation_20260916_143913.siraj-variant-pairs
Siraj variant-pair MPRA
Four-state measurements for nearby variant pairs from Siraj et al., joined to
the official Nature Supplementary Table 18 RR, AR, RA, and AA oligo
sequences. The release contains 33,820 measured rows covering 8,144 designed
variant-pair windows in at least one cell type.
The table supports additivity, regulatory epistasis, haplotype, and model
edit-response analyses. Public interaction_log2_skew is the source
int_log2Skew; it belongs to the normalized… See the full description on the dataset page: https://huggingface.co/datasets/Taykhoom/siraj-variant-pairs.gaia-dr3-vari-classifier-class-definition
Gaia DR3 variability classifier class definitions
This reference table describes the published variability classes used by the Gaia DR3 classifier recorded in vari_classifier_definition and applied in vari_classifier_result. ESA's DR3 table contains the classes for the nTransits:5+ classifier.
Use
python -m venv .venv && .venv/bin/pip install datasets pyarrow
from datasets import load_dataset
classes =… See the full description on the dataset page: https://huggingface.co/datasets/astro-legacy-archive/gaia-dr3-vari-classifier-class-definition.