datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
escorpius-mr
esCorpius Multilingual Raw
In the recent years, Transformer-based models have lead to significant advances in language modelling for natural language processing. However, they require a vast amount of data to be (pre-)trained and there is a lack of corpora in languages other than English. Recently, several initiatives have presented multilingual datasets obtained from automatic web crawling. However, they present important shortcomings for languages different from English, as they… See the full description on the dataset page: https://huggingface.co/datasets/LHF/escorpius-mr.esc50https://github.com/karolpiczak/ESC-50
The dataset is available under the terms of the Creative Commons Attribution Non-Commercial license.
K. J. Piczak. ESC: Dataset for Environmental Sound Classification. Proceedings of the 23rd Annual ACM Conference on Multimedia, Brisbane, Australia, 2015.
[DOI: http://dx.doi.org/10.1145/2733373.2806390]
esci
Dataset Card for "esci"
ESCI product search dataset
https://github.com/amazon-science/esci-data/
Preprocessings:
-joined the two relevant files
-product_text aggregate all product text
-mapped esci_label to full name
@article{reddy2022shopping,
title={Shopping Queries Dataset: A Large-Scale {ESCI} Benchmark for Improving Product Search},
author={Chandan K. Reddy and Lluís Màrquez and Fran Valero and Nikhil Rao and Hugo Zaragoza and Sambaran Bandyopadhyay and Arnab Biswas and Anlu… See the full description on the dataset page: https://huggingface.co/datasets/tasksource/esci.esconvThe ESConv dataset. GitHub repo. Original paper.
@inproceedings{liu-etal-2021-towards,
title={Towards Emotional Support Dialog Systems},
author={Liu, Siyang and
Zheng, Chujie and
Demasi, Orianna and
Sabour, Sahand and
Li, Yu and
Yu, Zhou and
Jiang, Yong and
Huang, Minlie},
booktitle={ACL},
year={2021}
}
EsCoLA
Introduction
The Spanish Corpus of Linguistic Acceptability (EsCoLA) includes 11,174 sentences taken from linguistic literature with a binary annotation made by the original authors themselves. The work is inspired by CoLA: https://nyu-mll.github.io/CoLA/#
Paper
Núria Bel, Marta Punsola, Valle Ruiz-Fernández, 2024, EsCoLA: Spanish Corpus of Linguistic Acceptability. Joint International Conference on Computational Linguistics, Language Resources and Evaluation LREC-COLING… See the full description on the dataset page: https://huggingface.co/datasets/nbel/EsCoLA.raw_tts_esc_ESPnet_espnet_mls-audioset_soundstream_16kescorpiusSpanish datasetraw_tts_esc_ESPnet_espnet_mls-multi_soundstream_16kesc50-parquetsynthcix-3m_br
SynthCIX-3M Dataset
Welcome to the Synthcix-3m_br dataset! This dataset contains a rich collection of synthetic images and captions, designed to support a variety of machine learning and computer vision tasks. Whether you're working on image generation, captioning, or any other related project, this dataset is a valuable resource.
Dataset Overview
The SynthCIX-3M dataset includes:
3 million synthetic images: High-quality images generated using advanced techniques.… See the full description on the dataset page: https://huggingface.co/datasets/escorciav/synthcix-3m_br.PathoROB-tolkach_esca
PathoROB
Preprint | Code | Licenses | Cite
PathoROB is a benchmark for the robustness of pathology foundation models (FMs) to non-biological medical center differences.
PathoROB contains four datasets covering 28 biological classes from 34 medical centers and three metrics:
Robustness Index: Measures the dominance of biological over non-biological features in an FM representation space.
Average Performance Drop (APD): Measures the robustness of downstream models to shortcut… See the full description on the dataset page: https://huggingface.co/datasets/bifold-pathomics/PathoROB-tolkach_esca.ESCIReranking
ESCIReranking
An MTEB dataset
Massive Text Embedding Benchmark
Task category
t2t
Domains
Written
Reference
https://github.com/amazon-science/esci-data/
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["ESCIReranking"])
evaluator = mteb.MTEB(task)
model = mteb.get_model(YOUR_MODEL)
evaluator.run(model)
To learn more about how to run models on mteb task check out… See the full description on the dataset page: https://huggingface.co/datasets/mteb/ESCIReranking.esc50_synthraw_tts_esc_ESPnet_espnet_mls-english_soundstream_16kamazon-esci-data
Amazon Shopping Queries Dataset
Dataset for improving product search, ranking and recommendations, featuring query-product pairs with detailed relevance labels.
Overview
The dataset contains search queries paired with up to 40 potentially relevant products, each labeled using the ESCI system:
Exact match: Products that perfectly match the customer's search intent (e.g., searching "iPhone 13" and finding "Apple iPhone 13 128GB")
Substitute product: Alternative products… See the full description on the dataset page: https://huggingface.co/datasets/milistu/amazon-esci-data.escape-simulator-gameplay-data
密室逃脱模拟器
This public dataset repository contains local gameplay data uploaded from F:\密室逃脱模拟器.
Contents
Files: 211
Total local size: 102.72 GB
Generated: 2026-06-05 02:51:23 UTC
File Types
.jsonl: 62
.png: 52
.json: 49
.mkv: 17
.txt: 16
.parquet: 15
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage, audio… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/escape-simulator-gameplay-data.OpenRTLSet
Dataset Card for OpenRTLSet: A Fully Open-Source Dataset for Large Language Model-based Verilog Module Design
Authors: Jinghua Wang, Lily Jiaxin Wan, Sanjana Pingali, Scott Smith, Manvi Jha, Shalini Sivakumar, Xing Zhao, Kaiwen Cao, Deming Chen
Dataset Summary
This is the 131k dataset generated in our paper: OpenRTLSet: A Fully Open-Source Dataset for Large Language Model-based Verilog Module Design.
In this work, we introduce OpenRTLSet: a… See the full description on the dataset page: https://huggingface.co/datasets/ESCAD/OpenRTLSet.tcga-esca-tabular-open
TCGA-ESCA — Tabular (Open Access)
Open-access TCGA-ESCA data from the NCI Genomic Data Commons, reshaped into one table per GDC data_type. Clinical, biospecimen and every open molecular modality for this cohort, in one place, queryable without downloading a single .tar or parsing a single TSV.
GDC data release: Data Release 46.0 - August 10, 2026
Built: 2026-09-12 03:54:06 UTC
Scope: one TCGA project — see [the family][repo] for the others
from datasets import load_dataset… See the full description on the dataset page: https://huggingface.co/datasets/gabrielaltay/tcga-esca-tabular-open.Skill-normalisation-ESCO-graded
skill-normalisation-esco-graded
Graded-relevance annotations for surface skill terms (ESCO alt-labels) from
ESCO v1.1.0 skill-normalisation pairs
against the ESCO v1.1.0 skill taxonomy. Layout follows the
BEIR convention so it is drop-in for
MTEB-style retrieval evaluators.
This dataset was created for the RecSys-HR 2026 WorkRB challenge.
Configs
config
split
rows
columns
queries
validation
50
_id (query id), text (ESCO alt-label / surface term to… See the full description on the dataset page: https://huggingface.co/datasets/TechWolf/Skill-normalisation-ESCO-graded.es_corpora_parliament_processedSynthetic-ESCO-skill-sentences
Synthetic job ads for all ESCO skills
Dataset Summary
This dataset contains 10 synthetically generated job ad sentences for almost all (99.5%) skills in ESCO v1.1.0.
Languages
We use the English version of ESCO, and all generated sentences are in English.
Dataset Structure
The dataset consists of 138,260 (sentence, skill) pairs.
Citation Information
If you use this dataset, please include the following reference:… See the full description on the dataset page: https://huggingface.co/datasets/TechWolf/Synthetic-ESCO-skill-sentences.agent-intrusion-escalation-forensics
Both Sides Detected It, Neither Escalated: Concurrency and Escalation Failure in the July 2026 Autonomous Agent Intrusion
This repository contains the corpus, ingestion pipeline and report for a forensic reconstruction
of the July 2026 autonomous agent intrusion, submitted to the Apart Research & CeSIA AI
Incident Response Sprint, Track 2 (Forensics and Forecasting).
By: Fatimah Mohamed Emad Elden
Trouve Labs
Detection was not the binding… See the full description on the dataset page: https://huggingface.co/datasets/FatimahEmadEldin/agent-intrusion-escalation-forensics.amazon_esci3dcs
3DCS: Datasets and Benchmark for Evaluating Conformational Sensitivity in Molecular Representations
3DCS is a benchmark for 3D conformational sensitivity in molecular representations (MRs). It tests whether the
representations of different conformers of the same molecule (i) preserve geometric variation, (ii) capture chirality,
and (iii) reflect the energy landscape. This is the Geometry–Chirality–Energy (GCE) evaluation framework from the
ICLR 2026 paper.
This repository holds… See the full description on the dataset page: https://huggingface.co/datasets/EscheWang/3dcs.toxicity_multilanguage_datasetesc50_24k_synthes_corpora_parliament_processedpvl_sftAPT_STYLE_Privilege_Escalation_Dataset
APT Privilege Escalation Dataset
Overview
The APT Privilege Escalation Dataset is a comprehensive collection of advanced and unique privilege escalation techniques tailored for Red Team training and offensive cybersecurity operations. This dataset, comprising 1000 entries, simulates real-world Advanced Persistent Threat (APT) tactics, focusing on exploiting misconfigurations, vulnerabilities, and novel attack vectors to achieve elevated privileges on Linux-based systems.… See the full description on the dataset page: https://huggingface.co/datasets/darkknight25/APT_STYLE_Privilege_Escalation_Dataset.esc50_no_overlap