datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
paired-llama-3.2-1b-embeddings-lmsys-chat-1m
Paired Llama 3.2 1B Token Embeddings (LMSYS-Chat-1M)
This dataset contains paired activations corresponding to single token locations extracted from Meta's Llama 3.2 1B Instruct on conversations from LMSYS-Chat-1M.
Embeddings are provided for layers 5 through 14, which capture the most interesting intermediate representations.
This dataset was built to study things like:
Learning different basis for activations at a given layer
Studying if there are cases where position encodes… See the full description on the dataset page: https://huggingface.co/datasets/scaleinvariant/paired-llama-3.2-1b-embeddings-lmsys-chat-1m.Athar-Embeddingswikipedia-22-12-en-embeddings-all-MiniLM-L6-v2
Dataset Card for "wikipedia-22-12-en-embeddings-all-MiniLM-L6-v2"
More Information needed
relaion2b-natural-embeddings
LAION-Natural Embeddings: CLIP ViT-H/14 Features for ~500M Natural Photographs (CCN 2025, Roth & Hebart)
LAION-Natural Embeddings provides pre-computed CLIP ViT-H/14 embeddings for ~500 million natural photographs from ReLAION-2B, filtered using the LAION-Natural naturalness classifier (score > 0.7).
Also known as: LAION-Natural Embeddings · ReLAION-Natural Embeddings · LAION-2B-Natural Embeddings
Part of the LAION-Natural dataset family, introduced in: How to sample the… See the full description on the dataset page: https://huggingface.co/datasets/andropar/relaion2b-natural-embeddings.asr-ser-quechua-collao-embeddings
ASR-SER embeddings for Quechua Collao
This repository contains embeddings only. It does not contain raw audio.
These embeddings were extracted for ASR-to-SER transfer experiments on the Quechua Collao emotional speech corpus. The release is intended for reproducible feature-extraction experiments and downstream analysis.
Dataset contents
One PyTorch tensor per utterance stored as an embedding file under embeddings/
A sanitized metadata table describing utterance… See the full description on the dataset page: https://huggingface.co/datasets/QuechuaBase/asr-ser-quechua-collao-embeddings.search-v3-embeddings
Hub Card Search Embeddings (v3)
One-sentence summaries and 1024-d embeddings for 1,173,030 dataset and model cards on the
Hugging Face Hub — 536,870 datasets and 636,160 models. It is the search index behind the revived
librarian-bots/huggingface-semantic-search
backend: you search over a short model-written summary of each card rather than the raw card, and
retrieve against the embedding of that summary.
The cards come from librarian-bots/dataset_cards_with_metadata
and… See the full description on the dataset page: https://huggingface.co/datasets/davanstrien/search-v3-embeddings.datacomp-small-with-text-embeddings
Dataset Card for "datacomp-small-with-text-embeddings"
More Information needed
capstone_sakuga_iblip_t5_embeddingsdatacomp-small-with-embeddings
Dataset Card for "datacomp-small-with-embeddings"
More Information needed
midjourney-prompts-embeddings
Midjourney Prompt–Embedding Dataset
This dataset is derived from our COLM 2024 paper, Iteratively Prompting Multimodal LLMs to Reproduce Natural and AI-Generated Images. The paper studies whether multimodal language models can infer prompts that generate images visually similar to target images produced by text-to-image systems or found in stock image collections, highlighting the relationship between real-world prompts and generated images as well as broader economic and security… See the full description on the dataset page: https://huggingface.co/datasets/AliN96/midjourney-prompts-embeddings.training-embeddingsdatacomp-small-with-embeddings-and-cluster-labels
Dataset Card for "datacomp-small-with-embeddings-and-cluster-labels"
More Information needed
msmarco_answerai_colbert_small_embeddings
MS MARCO ColBERT Embeddings
Pre-computed ColBERT embeddings for MS MARCO using PyLate and answerdotai/answerai-colbert-small-v1.
Dataset Structure
The dataset contains:
data/corpus/: 177 parquet files with document embeddings
data/queries/: 11 parquet files with query embeddings
data/qrels/train.parquet: Relevance judgments (532,751 pairs)
Usage
from datasets import load_dataset
# Load from directory (recommended for large datasets)
corpus =… See the full description on the dataset page: https://huggingface.co/datasets/WenxingZhu/msmarco_answerai_colbert_small_embeddings.airbnb_embeddings
Overview
This dataset consists of AirBnB listings with property descriptions, reviews, and other metadata.
It also contains text embeddings of the property descriptions as well as image embeddings of the listing image. The text embeddings were created using OpenAI's text-embedding-3-small model and the image embeddings using OpenAI's clip-vit-base-patch32 model available on Hugging Face.
The text embeddings have 1536 dimensions, while the image embeddings have 512 dimensions.… See the full description on the dataset page: https://huggingface.co/datasets/MongoDB/airbnb_embeddings.carbon-embeddings
carbon-embeddings
AINovice2005/carbon-embeddings is a derived dataset from the sampled subset of carbon-cpu-enriched-sequences containing dense vector embeddings of biological sequence records.
Each row corresponds to a source sequence identified by record_id. The dataset retains the sequence's position within the processed corpus through start and end and provides a numerical embedding representing the sequence in the embedding model's learned representation space.
The dataset… See the full description on the dataset page: https://huggingface.co/datasets/AINovice2005/carbon-embeddings.legacysurveys-dr10-20-embeddings-pca
Legacy DR10 r<20 Embeddings
AION-Search and AION embeddings for Legacy DR10 galaxies with r_mag < 20 mag.
This dataset stores AION-Search embeddings 96-dim PCA projections rather than the original 1024-dim. The PCA model files aion_search_pca96_model.npz is included in this repository and is needed after transforming a text query through AION-Search.
import numpy as np
pca = np.load("aion_search_pca96_model.npz")
x96 = (x1024 - pca["mean"]) @ pca["components"].T
x96 /=… See the full description on the dataset page: https://huggingface.co/datasets/astronolan/legacysurveys-dr10-20-embeddings-pca.ALPHAGenome-Embeddings
ALPHAGenome hg38 Embeddings
Pre-computed ALPHAGenome DNA foundation model embeddings for the entire human genome (hg38 / GRCh38).
The human genome is divided into ~22,000 non-overlapping 131 KB bins. Each bin's DNA sequence is embedded into a 3,072-dimensional latent space using the ALPHAGenome foundation model.
Companion project
These embeddings power the ALPHAGenome UMAP Explorer — an interactive browser visualization of latent relationships between genomic regions:
→… See the full description on the dataset page: https://huggingface.co/datasets/lagosproject/ALPHAGenome-Embeddings.openaccess-embeddings-siglip2
metmuseum/openaccess-embeddings-siglip2
Image embeddings for every public-domain artwork in metmuseum/openaccess, produced by google/siglip2-so400m-patch14-384.
Column
Type
Notes
objectID
int64
Primary key — matches objectID in metmuseum/openaccess
embedding
list<float32>
L2-normalised, dim = 1152
model
string
Source model id
dim
int32
Embedding dimension
Image bytes are not stored here; join against the main dataset to recover them.Embedding spec: dim=1152… See the full description on the dataset page: https://huggingface.co/datasets/metmuseum/openaccess-embeddings-siglip2.legacysurveys-dr10-20-embeddings
Legacy DR10 r<20 Embeddings
AION-Search and AION embeddings for Legacy DR10 galaxies with r_mag < 20 mag
License & data source
The embeddings and packaging in this repository are released under the MIT License.
The underlying catalog data are derived from the Legacy Survey DR10 and remain subject to the original Legacy Survey data-use policy and required acknowledgements.
Embeddings Citation
@misc{koblischke2025semantic,
title={Semantic search for 100M+… See the full description on the dataset page: https://huggingface.co/datasets/astronolan/legacysurveys-dr10-20-embeddings.oc20-s2ef-uma-embeddingsMAPS-ClinVar-VKS-Embeddings-L80
MAPS ClinVar/VKS ESM-C layer-80 difference fields
Mutant-minus-wild-type difference fields at block 80 of ESM-C 6B for
all 200,913 human missense variants of known clinical
significance in the MAPS ClinVar/VKS set: the complete
12,565-variant held-out test split and the complete
188,348-variant training pool, no sampling on either side.
260.8 GB of raw fp16 payload, 154.0 GB on disk in 262 shards, one parquet row per variant, every row self-describing — no join with
any other… See the full description on the dataset page: https://huggingface.co/datasets/ching-goodfire/MAPS-ClinVar-VKS-Embeddings-L80.OXE_taco_play_embeddingsLanguage Table (LeRobot) — Embedding-Only Release
(DINOv3 + SigLIP2 image features; EmbeddingGemma task-text features)
This repository packages a re-encoded variant of IPEC-COMMUNITY/taco_play_lerobot where raw videos are replaced by fixed-length image embeddings, and task strings are augmented with text embeddings. All indices, splits, and semantics remain consistent with the source dataset while storage and I/O are substantially lighter. To make the dataset practical to upload/download and… See the full description on the dataset page: https://huggingface.co/datasets/saaduddinM/OXE_taco_play_embeddings.ESdB-Embeddings-for-Sequential-data-Benchmark
ESdB: Embeddings for Sequential Data Benchmark
ESdB provides reproducible splits, evaluation shifts, and downstream targets
for benchmarking representations of sequential data.
This repository contains benchmark annotations only. It does not redistribute
the original events or input features. Original datasets must be obtained from
their respective sources and can be reproduced with the preprocessing code in
the ESdB repository.
Structure
Each dataset contains… See the full description on the dataset page: https://huggingface.co/datasets/On-Point-Rnd/ESdB-Embeddings-for-Sequential-data-Benchmark.OXE_kuka_embeddingsLanguage Table (LeRobot) — Embedding-Only Release
(DINOv3 + SigLIP2 image features; EmbeddingGemma task-text features)
This repository packages a re-encoded variant of IPEC-COMMUNITY/kuka_lerobot where raw videos are replaced by fixed-length image embeddings, and task strings are augmented with text embeddings. All indices, splits, and semantics remain consistent with the source dataset while storage and I/O are substantially lighter. To make the dataset practical to upload/download and stream… See the full description on the dataset page: https://huggingface.co/datasets/saaduddinM/OXE_kuka_embeddings.tae-data-embeddingsgemma-2b-dictionary-embeddings-all-layers
Gemma-2B Dictionary Embeddings - All Layers
This dataset contains pre-computed embeddings for 77,477 English words from WordNet using the Gemma-2B model across all 27 layers.
Dataset Structure
metadata.json: Contains dataset metadata (model info, dimensions, word count)
embeddings_layer_X.pkl: Pickle files containing embeddings for layer X (0-26)
Usage
import pickle
from huggingface_hub import hf_hub_download
# Download a specific layer
layer_0_path =… See the full description on the dataset page: https://huggingface.co/datasets/LeeHarrold/gemma-2b-dictionary-embeddings-all-layers.pubmed-embeddings
PubMed Embedding Vectors
This dataset contains embedding vectors generated from local PubMed title and abstract text.
It is designed for biomedical retrieval and nearest-neighbor research.
The public files intentionally do not include PubMed titles, abstracts, or full text.
Rows contain PMIDs, embeddings, hashes, and lightweight metadata so researchers can join
against their own authorized PubMed mirror or the official NCBI/PubMed services.
Configs
Config
Model… See the full description on the dataset page: https://huggingface.co/datasets/aaekay/pubmed-embeddings.cis5300-word-embeddings
Word Embeddings and Semantic Similarity (CIS 5300)
Dataset Description
This dataset supports learning about word embeddings — dense vector representations that capture word meaning. It includes a standard similarity benchmark, a word sense disambiguation task, and a Shakespeare corpus for training custom embeddings.
Configs
SimLex-999: Word Similarity Benchmark
SimLex-999 (Hill et al., 2015) is a gold-standard benchmark for evaluating word… See the full description on the dataset page: https://huggingface.co/datasets/CCB/cis5300-word-embeddings.OXE_berkeley_fanuc_manipulation_embeddingsLanguage Table (LeRobot) — Embedding-Only Release
(DINOv3 + SigLIP2 image features; EmbeddingGemma task-text features)
This repository packages a re-encoded variant of IPEC-COMMUNITY/berkeley_fanuc_manipulation_lerobot where raw videos are replaced by fixed-length image embeddings, and task strings are augmented with text embeddings. All indices, splits, and semantics remain consistent with the source dataset while storage and I/O are substantially lighter. To make the dataset practical to… See the full description on the dataset page: https://huggingface.co/datasets/saaduddinM/OXE_berkeley_fanuc_manipulation_embeddings.SQuADDS_Layout_Embeddings
SQuADDS Layout Embeddings
Versioned layout representations for the 24,106 GDS artifacts in
SQuADDS/SQuADDS_Layouts.
Static embedding model v0
static-embedding-v0 implements the original SQuADDS proof-of-concept model:
v0 = parameter_sum + geometric_moments + flattened_shape_bitmap
Each unit-normalized vector has 9,227 dimensions:
Block
Dimensions
Contents
Parameter sum
1
Permutation- and parameter-count-invariant sum of numerical design options… See the full description on the dataset page: https://huggingface.co/datasets/SQuADDS/SQuADDS_Layout_Embeddings.