datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
SSL4EO-S12-v1.1
SSL4EO-S12-v1.1
Attention: The Zarr Chunk file version of SSL4EO-S12-v1.1 was moved to embed2scale/SSL4EO-S12-v1.1-Zarr. This repository contains data that can be used with webdataset.
The dataset includes 246,144 locations with four timestamps each from the modalities S2L1C, S2L2A, S2RGB, S1GRD, LULC, DEM, and NDVI.
We refer to our technical report for details.
The samples are stored in as Zarr Zip files (zarr version 2) with the metadata directly aligned as additional data… See the full description on the dataset page: https://huggingface.co/datasets/embed2scale/SSL4EO-S12-v1.1.mmu_ssl_legacysurvey_north
mmu_ssl_legacysurvey_north HATS Catalog Collection
This is the collection of HATS catalogs representing mmu_ssl_legacysurvey_north.
This dataset is part of the Multimodal Universe,
a large-scale collection of multimodal astronomical data. For full details, see the paper:
The Multimodal Universe: Enabling Large-Scale Machine Learning with 100TBs of Astronomical Scientific Data.
Access the catalog
We recommend the use of the LSDB Python framework to access HATS… See the full description on the dataset page: https://huggingface.co/datasets/UniverseTBD/mmu_ssl_legacysurvey_north.Core-S1RTC-SSL4EO
Core-S1RTC-SSL4EO 📡⚡🛰️
Dataset
Modality
Number of Embeddings
Sensing Type
Total Comments
Source Dataset
Source Model
Size
Core-S1RTC-SSL4EO
Sentinel-1 RTC
36,748,875
SAR
General-Purpose Global
Core-S1RTC
SSL4EO-ResNet50-MOCO
332.5 GB
Content
Field
TypeDescription
unique_id
string
hash generated from geometry, time, product_id, and embedding model
embedding
array
raw embedding array
grid_cell
string
Major TOM cell
grid_row_u
int
Major… See the full description on the dataset page: https://huggingface.co/datasets/Major-TOM/Core-S1RTC-SSL4EO.Core-S2L1C-SSL4EO
Core-S2L1C-SSL4EO 🟥🟩🟦🟧🟨🟪 🛰️
Dataset
Modality
Number of Embeddings
Sensing Type
Total Comments
Source Dataset
Source Model
Size
Core-S2L1C-SSL4EO
Sentinel-2 (Level 1C)
56,147,150
Multi-Spectral
General-Purpose Global
Core-S2L1C
SSL4EO-ResNet50-DINO
252.9 GB
Content
Field
Type
Description
unique_id
string
hash generated from geometry, time, product_id, and embedding model
embedding
array
raw embedding array
grid_cell
string
Major TOM… See the full description on the dataset page: https://huggingface.co/datasets/Major-TOM/Core-S2L1C-SSL4EO.ssl4eol_etm_srssl_read_wav_stripedmmu_ssl_legacysurvey_north_aion_demo
tokenized_demo
AION-1 tokens for hf://datasets/UniverseTBD/mmu_ssl_legacysurvey_north, produced with aion-hats. The catalog keeps the HATS layout of its source, so it can be opened with lsdb.open_catalog(...) and joined back to the source on _healpix_29/object_id, or loaded with datasets.load_dataset(...).
Tokenized columns:
image -> tok_image (LegacySurveyImage)
mmu_ssl_legacysurvey_north_aion_tokens_10k
ls_north_tokens_10k
AION-1 tokens for hf://datasets/UniverseTBD/mmu_ssl_legacysurvey_north, produced with aion-hats. The catalog keeps the HATS layout of its source, so it can be opened with lsdb.open_catalog(...) and joined back to the source on _healpix_29/object_id, or loaded with datasets.load_dataset(...).
Tokenized columns:
image -> tok_image (LegacySurveyImage)
ebv -> tok_ebv (LegacySurveyEBV)
flux_g -> tok_flux_g (LegacySurveyFluxG)
flux_r -> tok_flux_r… See the full description on the dataset page: https://huggingface.co/datasets/EiffL/mmu_ssl_legacysurvey_north_aion_tokens_10k.faroese-ssl-fo
Strandfaraskip Landsins (ssl_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Transport law, ferry and bus statistics, reports, timetables, guidance, HTML pages and
documents.
Source: Strandfaraskip Landsins
Size
Measure
Value
Documents
1,015
Characters
1,518,963
Tokens
650,125
Possible official documents
8
Tokens in possible official documents
4,782
File type
Documents… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-ssl-fo.mmu_desi_edr_sv3_x_mmu_ssl_legacysurvey_north
mmu_desi_edr_sv3 × mmu_ssl_legacysurvey_north
A lightweight match-index that pairs LegacySurvey imaging objects with DESI
spectra: ~138k matched pairs, published as ~tens of MB of id pointers, not
pixels. It is part of the Multimodal Universe
crossmatch tooling (see the HATS crossmatch blogpost)
and is the fast-path source for the AstroPT v3
image×spectrum pairs stream.
This is an index of object ids + HATS partition cells. Every row is one
matched pair: where to find the image… See the full description on the dataset page: https://huggingface.co/datasets/Smith42/mmu_desi_edr_sv3_x_mmu_ssl_legacysurvey_north.mo436-ssl-pretraining-cropsSSL_dupdemoThis dataset was created using LeRobot.
Viewer 2.0
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "xarm7",
"total_episodes": 1,
"total_frames": 10,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 50,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/luc-ssl/demo.ssl4eol_oli_srisac-simo-ssl-unlabeled-demo
isac-simo-ssl-unlabeled-demo
Tiny synthetic stand-in for Build Change's unlabeled field photo pool. Deliberately broader than the labeled sets (walls, rebar, roofing, and a deliberately low-quality frame) because the real Drive dump is a superset of the labeled data, not a matched copy of it. Five images. Teaching use only.
Sampled_SSLmo436-ssl-pretrainingnew_instruct_no_sslssl_legacysurvey---
description: 'Image dataset based on Legacy Survey stamps assembled by George Stein
'
homepage: https://github.com/georgestein/ssl-legacysurvey
version: 1.0.0
citation: "% % ACKNOWLEDGEMENTS\n% % From: https://www.legacysurvey.org/\n% \n% When \ using data from the Legacy Surveys in papers, please use the following acknowledgment:\n % \n% The Legacy Surveys consist of three individual and complementary projects: \ the Dark Energy Camera Legacy Survey (DECaLS; Proposal ID #2014B-0404;… See the full description on the dataset page: https://huggingface.co/datasets/EiffL/ssl_legacysurvey.IP2P-edit-SSLWM-try-step50-7.5_1.5-200
Dataset Card for "IP2P-edit-SSLWM-try-step50-7.5_1.5-200"
More Information needed
IP2P-adwm_SSLWM-128-200ssllmv2.6-finalconversation-1
Dataset Card for "ssllmv2.6-finalconversation-1"
More Information needed
ibl_ssl_data
IBL SSL Dataset
To get the data run
from datasets import load_dataset
ds = load_dataset('berkott/ibl_ssl_data')
license: other
license_name: idkyet
license_link: LICENSE
dataset_info:
features:
- name: spikes
sequence:
sequence: float64
- name: region_cluster_ids
sequence: int64
- name: brain_regions
sequence: string
- name: bin_size
dtype: float64
- name: pid
dtype: string
- name: eid
dtype: string
- name: probe_name… See the full description on the dataset page: https://huggingface.co/datasets/berkott/ibl_ssl_data.ssl_read_wavSSL-Task4-mmSS-Libri