datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
lc_quadLC-QuAD 2.0 is a Large Question Answering dataset with 30,000 pairs of question and its corresponding SPARQL query. The target knowledge base is Wikidata and DBpedia, specifically the 2018 version. Please see our paper for details about the dataset creation process and framework.lc_quad_synth
LC-QuAD 2.0-synth
Dataset Summary
This dataset is an updated version of the LC-QuAD 2.0 dataset which includes LLM-based natural language translations of the corresponding wikidata queries. It also includes
verifier scores for the LLM translations and the original translations indicating the probability that the translation is correct (for details see our linked GitHub Repository).
It contains 19000 examples of queries and translations. It can be used for training and… See the full description on the dataset page: https://huggingface.co/datasets/timschwa/lc_quad_synth.lc_quad2
Dataset Card for LC-QuAD 2.0 with answers
lc_quad2-sparqltotext
Dataset Card for LC-QuAD 2.0 - SPARQLtoText version
Dataset Summary
Special version of LC-QuAD 2.0 for the SPARQL-to-Text task
New field simplified_query
New field is named "simplified_query". It results from applying the following step on the field "query":
Replacing URIs with a simpler format with prefix "resource:", "property:" and "ontology:".
Spacing the delimiters (, {, ., }, ).
Adding diversity to some filters which test a number (contains ( ?var… See the full description on the dataset page: https://huggingface.co/datasets/Orange/lc_quad2-sparqltotext.quadmix-stem-v2
QuaDMix-STEM v2: STEM-Focused Proxy Validation Set with GPQA & MATH
Script: scripts/validation_set/prepare_stem_v2.py
HuggingFace: liujin99/quadmix-stem-v2
Files: stem_v2_tokenized.pt, stem_v2.parquet
Overview
STEM v2 is an upgraded validation set that fixes the two critical coverage gaps in STEM v1. In the v1 experiment, QuaDMix lost to Random downstream (CORE 0.1530 vs 0.1615), and root-cause analysis revealed:
gpqa_diamond had no direct proxy — mapped from… See the full description on the dataset page: https://huggingface.co/datasets/liujin99/quadmix-stem-v2.quadmix-stem-v1
QuaDMix-STEM v1: STEM-Focused Proxy Validation Set
Script: scripts/validation_set/prepare_stem_v1.py
HuggingFace: liujin99/quadmix-stem-v1
Files: stem_v1_tokenized.pt, stem_v1.parquet
Overview
STEM v1 is a validation set designed to focus the proxy model's optimization signal on STEM capabilities — mathematics, science knowledge, and logical reasoning. Unlike CAP v1 (broad capability coverage) or core_bmk (benchmark test format), STEM v1 uses only tasks that… See the full description on the dataset page: https://huggingface.co/datasets/liujin99/quadmix-stem-v1.DBLP-QuAD DBLP-QuAD is a scholarly knowledge graph question answering dataset with 10,000 question - SPARQL query pairs targeting the DBLP knowledge graph. The dataset is split into 7,000 training, 1,000 validation and 2,000 test questions.QUAD-Bench
QUAD-Bench: A Lightweight AI Reasoning & Acuity Benchmark
QUAD-Bench is a compact, multiple-choice benchmark dataset designed for quick evaluation of Large Language Models (LLMs). The dataset contains 100 questions evenly distributed across 4 fundamental capabilities, requiring the model to select exactly one correct answer option (A, B, C, or D).
📊 Dataset Structure
The benchmark consists of 100 questions divided into 4 categories (25 questions each):… See the full description on the dataset page: https://huggingface.co/datasets/RaspizdAI/QUAD-Bench.