datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
task09_close_refrigerator_gist_0804
task09_close_refrigerator_gist_0804
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 9 입니다.
kiroaiseoul 네이밍(task09_close_refrigerator)에 맞춰 재배포한 사본이고, 원본 배포명은 task9-close-fridge-door_0804 입니다.
이 스테이지는 GIST가 원본과 _0804 재수집본을 둘 다 배포했다. 이쪽이 0804 재수집본이고,
원본은 kiroaiseoul/task09_close_refrigerator_gist 에 있다.
Task: "Close the fridge door while holding the beaker"
Episodes: 1,049 / Frames: 306,210
FPS: 30 · robot_type: mobileai_robot · codebase_version: v3.0
Cameras: cam_high… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task09_close_refrigerator_gist_0804.evaluator-leaderboardtask06_pickup_beaker_and_move_to_refrigerator_gist
task06_pickup_beaker_and_move_to_refrigerator_gist
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 6 입니다.
kiroaiseoul 네이밍(task06_pickup_beaker_and_move_to_refrigerator)에 맞춰 재배포한 사본이고, 원본 배포명은 task6-shake-beaker-and-move-to-fridge 입니다.
이 스테이지는 GIST가 원본과 _0804 재수집본을 둘 다 배포했다. 이쪽이 원본이고,
재수집본은 kiroaiseoul/task06_pickup_beaker_and_move_to_refrigerator_gist_0804 에 있다. 베이스 결함률은 대체로 재수집본이 더 낮다.
Task: "Grab and shake the filled beaker, then move to the front of the fridge"
Episodes: 779… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task06_pickup_beaker_and_move_to_refrigerator_gist.puzzlescript-gists
PuzzleScript Human-Authored Games (Full Gist Corpus)
35,704 human-authored PuzzleScript games — the
complete source text of each — collected from public GitHub gists.
This is the full corpus: every distinct gist is kept, and each row is tagged
with its deduplication cluster so you can reduce to a unique set with a one-line
filter. The deduplication is reproducible from the shipped dedup_master.json +
dedup_master.py; non-vanilla PuzzleScript-Plus files are excluded (listed in… See the full description on the dataset page: https://huggingface.co/datasets/smearle/puzzlescript-gists.StereoTales
Multilingual Story-Generation Bias Samples
A multilingual evaluation dataset for probing demographic biases in LLM
story generation. Each sample instructs a model to write a ~200-word story
about a character carrying a given demographic attribute value (age, gender,
ethnicity, religion, disability status, immigration status, ...) placed into a
specific life scenario, with the goal of surfacing socio-economic and
demographic biases in the generated narratives.… See the full description on the dataset page: https://huggingface.co/datasets/giskardai/StereoTales.GSA-PT-Qwen2-7B-Instruct-chunk4-chunk4-data
GSA-PT-Qwen2-7B-Instruct-chunk4-chunk4-data
This is the continue pretraining dataset used for training GSA (Gist Sparse Attention) models based on Qwen2-7B-Instruct with chunk size chunk4-chunk4.
Each sample is tokenized and formatted with GSA gist tokens for continue pretraining.
Paper
GSA: Gist Sparse Attention via Learnable Compression and Selective Unfolding
Related Model
yuzhenm/GSA-PT-Qwen2-7B-Instruct-chunk4-chunk4 — model trained on this dataset
task02_pickup_tubes_gist
task02_pickup_tubes_gist
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 2 입니다.
kiroaiseoul 네이밍(task02_pickup_tubes)에 맞춰 재배포한 사본이고, 원본 배포명은 task2-pick-two-tubes-from-rack 입니다.
Task: "Pick two tubes out of the rack with both hands"
Episodes: 2,019 / Frames: 933,799
FPS: 30 · robot_type: mobileai_robot · codebase_version: v3.0
Cameras: cam_high, cam_left_wrist, cam_right_wrist (480x640x3, h264)
action / observation.state: 16D (Mobile AI — base 2 + left 7 + right 7)… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task02_pickup_tubes_gist.task05_tube_disposal_gist
task05_tube_disposal_gist
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 5 입니다.
kiroaiseoul 네이밍(task05_tube_disposal)에 맞춰 재배포한 사본이고, 원본 배포명은 task5-dispose-empty-tubes-in-tray 입니다.
Task: "Dispose of the two empty tubes into the tube disposal tray"
Episodes: 2,001 / Frames: 580,038
FPS: 30 · robot_type: mobileai_robot · codebase_version: v3.0
Cameras: cam_high, cam_left_wrist, cam_right_wrist (480x640x3, h264)
action / observation.state: 16D (Mobile AI — base 2 + left 7 + right 7)… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task05_tube_disposal_gist.task07_open_refrigerator_gist
task07_open_refrigerator_gist
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 7 입니다.
kiroaiseoul 네이밍(task07_open_refrigerator)에 맞춰 재배포한 사본이고, 원본 배포명은 task7-open-fridge-door 입니다.
이 스테이지는 GIST가 원본과 _0804 재수집본을 둘 다 배포했다. 이쪽이 원본이고,
재수집본은 kiroaiseoul/task07_open_refrigerator_gist_0804 에 있다. 베이스 결함률은 대체로 재수집본이 더 낮다.
Task: "Open the fridge door while holding the beaker"
Episodes: 1,000 / Frames: 215,930
FPS: 30 · robot_type: mobileai_robot · codebase_version: v3.0
Cameras: cam_high… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task07_open_refrigerator_gist.task09_close_refrigerator_gist
task09_close_refrigerator_gist
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 9 입니다.
kiroaiseoul 네이밍(task09_close_refrigerator)에 맞춰 재배포한 사본이고, 원본 배포명은 task9-close-fridge-door 입니다.
이 스테이지는 GIST가 원본과 _0804 재수집본을 둘 다 배포했다. 이쪽이 원본이고,
재수집본은 kiroaiseoul/task09_close_refrigerator_gist_0804 에 있다. 베이스 결함률은 대체로 재수집본이 더 낮다.
Task: "Close the fridge door while holding the beaker"
Episodes: 1,897 / Frames: 330,313
FPS: 30 · robot_type: mobileai_robot · codebase_version: v3.0
Cameras:… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task09_close_refrigerator_gist.task08_takeout_and_put_beaker_gist_0804
task08_takeout_and_put_beaker_gist_0804
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 8 입니다.
kiroaiseoul 네이밍(task08_takeout_and_put_beaker)에 맞춰 재배포한 사본이고, 원본 배포명은 task8-swap-beakers-in-fridge_0804 입니다.
이 스테이지는 GIST가 원본과 _0804 재수집본을 둘 다 배포했다. 이쪽이 0804 재수집본이고,
원본은 kiroaiseoul/task08_takeout_and_put_beaker_gist 에 있다.
Task: "Take out the stored beaker and put the held beaker into the fridge"
Episodes: 1,831 / Frames: 889,058
FPS: 30 · robot_type: mobileai_robot · codebase_version:… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task08_takeout_and_put_beaker_gist_0804.GSA-PT-Qwen2-7B-Instruct-chunk16-data
GSA-PT-Qwen2-7B-Instruct-chunk16-data
This is the continue pretraining dataset used for training GSA (Gist Sparse Attention) models based on Qwen2-7B-Instruct with chunk size chunk16.
Each sample is tokenized and formatted with GSA gist tokens for continue pretraining.
Paper
GSA: Gist Sparse Attention via Learnable Compression and Selective Unfolding
Related Model
yuzhenm/GSA-PT-Qwen2-7B-Instruct-chunk16 — model trained on this dataset
task08_takeout_and_put_beaker_gist
task08_takeout_and_put_beaker_gist
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 8 입니다.
kiroaiseoul 네이밍(task08_takeout_and_put_beaker)에 맞춰 재배포한 사본이고, 원본 배포명은 task8-swap-beakers-in-fridge 입니다.
이 스테이지는 GIST가 원본과 _0804 재수집본을 둘 다 배포했다. 이쪽이 원본이고,
재수집본은 kiroaiseoul/task08_takeout_and_put_beaker_gist_0804 에 있다. 베이스 결함률은 대체로 재수집본이 더 낮다.
Task: "Place the held beaker into the fridge and take out the beaker inside"
Episodes: 168 / Frames: 146,939
FPS: 30 · robot_type: mobileai_robot ·… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task08_takeout_and_put_beaker_gist.tmp_widowX_paxini_peginsertThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "right",
"total_episodes": 45,
"total_frames": 36283,
"total_tasks": 3,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:45"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/gistailab/tmp_widowX_paxini_peginsert.task01_move_to_tube_rack_gist
task01_move_to_tube_rack_gist
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 1 입니다.
kiroaiseoul 네이밍(task01_move_to_tube_rack)에 맞춰 재배포한 사본이고, 원본 배포명은 task1-move-to-tube-rack 입니다.
Task: "Move from the start point to face the tube rack"
Episodes: 2,635 / Frames: 664,247
FPS: 30 · robot_type: mobileai_robot · codebase_version: v3.0
Cameras: cam_high, cam_left_wrist, cam_right_wrist (480x640x3, av1)
action / observation.state: 16D (Mobile AI — base 2 + left 7 + right 7)… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task01_move_to_tube_rack_gist.task07_open_refrigerator_gist_0804
task07_open_refrigerator_gist_0804
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 7 입니다.
kiroaiseoul 네이밍(task07_open_refrigerator)에 맞춰 재배포한 사본이고, 원본 배포명은 task7-open-fridge-door_0804 입니다.
이 스테이지는 GIST가 원본과 _0804 재수집본을 둘 다 배포했다. 이쪽이 0804 재수집본이고,
원본은 kiroaiseoul/task07_open_refrigerator_gist 에 있다.
Task: "Open the fridge door while holding the beaker"
Episodes: 1,010 / Frames: 159,490
FPS: 30 · robot_type: mobileai_robot · codebase_version: v3.0
Cameras: cam_high, cam_left_wrist… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task07_open_refrigerator_gist_0804.tmp_widowX_paxini_handtapThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "left",
"total_episodes": 32,
"total_frames": 4442,
"total_tasks": 4,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:32"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/gistailab/tmp_widowX_paxini_handtap.asca-gis2-screened-events
ASCA GIS2 screened events
python -m venv .venv && .venv/bin/pip install datasets huggingface_hub pyarrow
This dataset contains one ASCA GIS2 revision-2 screened PH-mode,
medium-telemetry-rate event file for GX5-1. It is the index-002 GIS2
medium-rate sibling under archive sequence path 10001000, named
ad10001000g200270m.evt.gz. The sequence number comes from the archive path
and filename; the FITS headers contain no OBS_ID keyword. The sequence's
screened directory contains… See the full description on the dataset page: https://huggingface.co/datasets/astro-legacy-archive/asca-gis2-screened-events.neodatasetThis dataset contains User Story text and Story Points
Dataset Structure
Features
Column name
Type
Description
idproject
int64
Project id
issuekey
int64
User Story key
created
string
Created at
title
string
User Story text
description
string
User Story description
storypoints
int64
Story Point
NEODATASET
NEODATASET is a dataset containing title and description in natural language of User Stories and their Story Points extracted… See the full description on the dataset page: https://huggingface.co/datasets/giseldo/neodataset.gistbench
GISTBench — Groundedness & Interest Specificity Test Bench
GISTBench evaluates how well LLMs understand users from their engagement history. Given a user's interactions with content (videos, articles, books, etc.), the benchmark measures whether an LLM can extract meaningful interests, ground them in evidence, and cite specific relevant items.
Dataset Details
Rows: 4,214,059 engagements
Users: ~1,000 anonymized users
Format: Parquet
Schema
Column
Type… See the full description on the dataset page: https://huggingface.co/datasets/facebook/gistbench.tmp_pack_position0827This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "mobileai_robot",
"total_episodes": 1,
"total_frames": 2082,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/gistailab/tmp_pack_position0827.task04_pour_liquid_from_tubes_to_beaker_gist
task04_pour_liquid_from_tubes_to_beaker_gist
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 4 입니다.
kiroaiseoul 네이밍(task04_pour_liquid_from_tubes_to_beaker)에 맞춰 재배포한 사본이고, 원본 배포명은 task4-pour-tubes-into-leftmost-beaker 입니다.
Task: "Pour the solution from both tubes into the leftmost beaker"
Episodes: 2,040 / Frames: 763,573
FPS: 30 · robot_type: mobileai_robot · codebase_version: v3.0
Cameras: cam_high, cam_left_wrist, cam_right_wrist (480x640x3, av1)
action / observation.state: 16D… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task04_pour_liquid_from_tubes_to_beaker_gist.task03_turn_to_face_beaker_gist
task03_turn_to_face_beaker_gist
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 3 입니다.
kiroaiseoul 네이밍(task03_turn_to_face_beaker)에 맞춰 재배포한 사본이고, 원본 배포명은 task3-scan-and-move-to-beaker 입니다.
Task: "Turn in place to face the beaker"
Episodes: 2,228 / Frames: 334,996
FPS: 30 · robot_type: mobileai_robot · codebase_version: v3.0
Cameras: cam_high, cam_left_wrist, cam_right_wrist (480x640x3, h264)
action / observation.state: 16D (Mobile AI — base 2 + left 7 + right 7)… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task03_turn_to_face_beaker_gist.task10_move_to_beaker_shelf_gist
task10_move_to_beaker_shelf_gist
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 10 입니다.
kiroaiseoul 네이밍(task10_move_to_beaker_shelf)에 맞춰 재배포한 사본이고, 원본 배포명은 task10-move-to-beaker-storage-shelf 입니다.
이 스테이지는 GIST가 원본과 _0804 재수집본을 둘 다 배포했다. 이쪽이 원본이고,
재수집본은 kiroaiseoul/task10_move_to_beaker_shelf_gist_0804 에 있다. 베이스 결함률은 대체로 재수집본이 더 낮다.
Task: "Move from the fridge to face the beaker storage shelf"
Episodes: 1,993 / Frames: 476,825
FPS: 30 · robot_type: mobileai_robot ·… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task10_move_to_beaker_shelf_gist.GSA-FT-Qwen2-7B-Instruct-chunk32-data
GSA-FT-Qwen2-7B-Instruct-chunk32-data
This is the supervised fine-tuning dataset used for training GSA (Gist Sparse Attention) models based on Qwen2-7B-Instruct with chunk size chunk32.
Each sample is tokenized and formatted with GSA gist tokens for supervised fine-tuning.
Paper
GSA: Gist Sparse Attention via Learnable Compression and Selective Unfolding
Related Model
yuzhenm/GSA-FT-Qwen2-7B-Instruct-chunk32 — model trained on this dataset
spatial-datasetsGSA-PT-Qwen2-7B-Instruct-chunk8-data
GSA-PT-Qwen2-7B-Instruct-chunk8-data
This is the continue pretraining dataset used for training GSA (Gist Sparse Attention) models based on Qwen2-7B-Instruct with chunk size chunk8.
Each sample is tokenized and formatted with GSA gist tokens for continue pretraining.
Paper
GSA: Gist Sparse Attention via Learnable Compression and Selective Unfolding
Related Model
yuzhenm/GSA-PT-Qwen2-7B-Instruct-chunk8 — model trained on this dataset
task06_pickup_beaker_and_move_to_refrigerator_gist_0804
task06_pickup_beaker_and_move_to_refrigerator_gist_0804
GIST AI Lab이 수집한 11스테이지 실험실 프로토콜 데이터 중 stage 6 입니다.
kiroaiseoul 네이밍(task06_pickup_beaker_and_move_to_refrigerator)에 맞춰 재배포한 사본이고, 원본 배포명은 task6-shake-beaker-and-move-to-fridge_0804 입니다.
이 스테이지는 GIST가 원본과 _0804 재수집본을 둘 다 배포했다. 이쪽이 0804 재수집본이고,
원본은 kiroaiseoul/task06_pickup_beaker_and_move_to_refrigerator_gist 에 있다.
Task: "Grab and shake the filled beaker, then move to the front of the fridge"
Episodes: 1,565 / Frames: 956… See the full description on the dataset page: https://huggingface.co/datasets/kiroaiseoul/task06_pickup_beaker_and_move_to_refrigerator_gist_0804.gist-960-euclidean
Dataset Overview
dataset: gist-960-euclidean
Metadata
Creation Time: 2025-01-07 11:03:48+0000
Update Time: 2025-01-07 11:04:44+0000
Source: https://github.com/erikbern/ann-benchmarks
Task: N/A
Train Samples: N/A
Test Samples: N/A
License: DISCLAIMER AND LICENSE NOTICE:
This dataset is intended for benchmarking and research purposes only.
The source data used in this dataset retains its original license and copyright. Users must comply with the respective licenses of… See the full description on the dataset page: https://huggingface.co/datasets/open-vdb/gist-960-euclidean.tmp_widowX_paxini_handtap_v2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "left",
"total_episodes": 68,
"total_frames": 6126,
"total_tasks": 3,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 30,
"splits": {
"train": "0:68"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path": null,
"features":… See the full description on the dataset page: https://huggingface.co/datasets/gistailab/tmp_widowX_paxini_handtap_v2.