datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
MA_Query_Expansion_MLT26wikipedia-multilingual-synthetic-ir-query
wikipedia-multilingual-synthetic-ir-query
This dataset contains multilingual Wikipedia-derived synthetic query-document pairs for information retrieval training.
It was created with the query-crafter-multilingual model, which generates search-like queries from Wikipedia text.
The current release contains two different retrieval settings:
short_doc: pairs of (query, short document)
long_doc: pairs of (query, long document)
These two subsets are not generated in the same way… See the full description on the dataset page: https://huggingface.co/datasets/hotchpotch/wikipedia-multilingual-synthetic-ir-query.bing_coronavirus_query_set
Dataset Card for BingCoronavirusQuerySet
Dataset Summary
Please note that you can specify the start and end date of the data. You can get start and end dates from here: https://github.com/microsoft/BingCoronavirusQuerySet/tree/master/data/2020
example:
load_dataset("bing_coronavirus_query_set", queries_by="state", start_date="2020-09-01", end_date="2020-09-30")
You can also load the data by country by using queries_by="country".
Supported Tasks and… See the full description on the dataset page: https://huggingface.co/datasets/microsoft/bing_coronavirus_query_set.wildchat-category-query-expanded-n6dare-query-activations
DARE Activation Cache
Midlayer residual-stream activations for training documents and behavior
queries in GaloisTheory123/dare-data.
Training Document Activations
File
Model
Description
custom_sft_gold/activations.parquet
jrosseruk/dare-domain-splits/train/gold
custom_sft_gold adapter (train/gold) activations
Columns: doc_idx, split, final_token_activation, mean_activation
Query Activations
File
Model
Description… See the full description on the dataset page: https://huggingface.co/datasets/GaloisTheory123/dare-query-activations.wildchat-reattributed-query-triplewildchat-reattributed-query-distinctwildchat-category-query-expanded-n3wildchat-reconstructed-query-distinctwildchat-reattributed-query-uniquedart-math-pool-gsm8k-query-info
[!NOTE]
This dataset is the synthesis information of queries from the GSM8K training set,
such as the numbers of raw/correct samples of each synthesis job.
Usually used with dart-math-pool-gsm8k.
🎯 DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving
📝 Paper@arXiv | 🤗 Datasets&Models@HF | 🐱 Code@GitHub
🐦 Thread@X(Twitter) | 🐶 中文博客@知乎 | 📊 Leaderboard@PapersWithCode | 📑 BibTeX
Datasets: DART-Math
DART-Math datasets are the… See the full description on the dataset page: https://huggingface.co/datasets/hkust-nlp/dart-math-pool-gsm8k-query-info.eval_piper_hpt_solo_camframe_queryfreq30This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "piper",
"total_episodes": 1,
"total_frames": 241,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:1"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/yukk1/eval_piper_hpt_solo_camframe_queryfreq30.UDM_extract_query_sample_sol
UDM extract → query (minimal-edit, GPT-5.6-Sol)
A search query for each of 99,997 English mathematical documents, produced by GPT-5.6-Sol under a
prompt that asks it to edit rather than rewrite: if the page contains a question somebody
actually asked, that question is the query, copied with as few changes as possible.
This is the companion to an earlier release built from the same documents with a rewriting
prompt. The two differ in one respect only — how the query is phrased —… See the full description on the dataset page: https://huggingface.co/datasets/oklenAI/UDM_extract_query_sample_sol.dart-math-pool-math-query-info
[!NOTE]
This dataset is the synthesis information of queries from the MATH training set,
such as the numbers of raw/correct samples of each synthesis job.
Usually used with dart-math-pool-math.
🎯 DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving
📝 Paper@arXiv | 🤗 Datasets&Models@HF | 🐱 Code@GitHub
🐦 Thread@X(Twitter) | 🐶 中文博客@知乎 | 📊 Leaderboard@PapersWithCode | 📑 BibTeX
Datasets: DART-Math
DART-Math datasets are the state-of-the-art… See the full description on the dataset page: https://huggingface.co/datasets/hkust-nlp/dart-math-pool-math-query-info.wildchat-category-query-expanded-n1database-query-logs-synthetic
Database Query Logs (synthetic)
3,995 database query-log entries spanning 10 engines - MySQL, PostgreSQL, MongoDB, SQL
Server, Oracle, MariaDB, SQLite, Cassandra, Redis, and Elasticsearch - with query text,
type, complexity, execution timing, and row-count metadata.
These queries are synthetic
The queries were programmatically generated, not captured from production systems.
They were produced by templating a set of query shapes across industry-flavored schema… See the full description on the dataset page: https://huggingface.co/datasets/robworks-software/database-query-logs-synthetic.query-crafter-multilingual-sft-synth-500k
query-crafter-multilingual-sft-synth-500k
hotchpotch/query-crafter-multilingual-sft-synth-500k is a multilingual synthetic supervision dataset for training query-generation models from raw passages. Each example pairs a source passage with a short retrieval-oriented target such as a question, keyword query, FAQ-style prompt, title, or compact summary.
This dataset was created as the supervised fine-tuning corpus for hotchpotch/query-crafter-multilingual.
What This… See the full description on the dataset page: https://huggingface.co/datasets/hotchpotch/query-crafter-multilingual-sft-synth-500k.japanese-query-crafter-reasoning-80k
思考過程を含む、クエリ作成のための日本語質問文テキストの合成データセット
fineweb2-edu-japanese の small_tokens_cleaned の文章データを元に、DeepSeek-R1 で文章(text)から質問文を作成したデータセットです。deekseek-r1 が出力した reasoning 部分も含まれます。testセットは、fineweb2-edu-japaneseのtestのみからサンプリングしています。
ライセンス
fineweb2 と同等の ODC-By とします。
wildchat-category-query-expanded-n10tpch-query-routing-dataset
Cross-Engine TPC-H Cost Modeling Dataset
📘 Overview
This dataset contains execution-time measurements and structural query features for SQL workloads executed across multiple database engines. It is designed for research in learned cost modeling, cross-engine optimization, and zero-shot SQL engine selection.
The dataset is generated using the TPC-H benchmark at Scale Factor .5 and includes automatically generated query variants for all 22 benchmark queries. Each query… See the full description on the dataset page: https://huggingface.co/datasets/Rinil-Parmar/tpch-query-routing-dataset.query-expansion-v1personal-query-grocery-and-gourmet-food
Personal Query: Grocery and Gourmet Food
This dataset contains personalized product search queries for the Grocery_and_Gourmet_Food category.
Each record is built from the Personal Query pipeline:
Stage 6 generated correct personalized queries.
Stage 7 injected user-specific error query variants when a matching error pattern was available.
Stage 5 provided the user profile complexity level.
Files
data.jsonl: all correct Stage 6 queries. Rows without Stage 7 error query… See the full description on the dataset page: https://huggingface.co/datasets/xxxxdszz/personal-query-grocery-and-gourmet-food.sadai-mrec-query-rewrite-13kclinical-quad-data-cut-timing-database-lock-pressure-query-backlog-csr-narrative-drift-v0.1Clinical Quad Data Cut Timing Database Lock Pressure Query Backlog CSR Narrative Drift v0.1
Each row is a trial monthly snapshot.
Core quad
Data cut timingDatabase lock pressureQuery backlogCSR narrative drift
Target
label_regulatory_issue_next_90d
Files
data/train.csvdata/tester.csvscorer.py
Evaluation
Run model on data/tester.csvReturn predictions row alignedScore with scorer.py
License
MIT
This dataset identifies a measurable coupling pattern associated with systemic instability.
The sample… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/clinical-quad-data-cut-timing-database-lock-pressure-query-backlog-csr-narrative-drift-v0.1.covid-bing-query-gpt4-avs_triplets
COVq dataset
This dataset was used in the paper GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning. Refer to https://arxiv.org/abs/2402.16829 for details.
The code for generating the data is available at https://github.com/avsolatorio/GISTEmbed.
Citation
@article{solatorio2024gistembed,
title={GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning},
author={Aivin V. Solatorio}… See the full description on the dataset page: https://huggingface.co/datasets/avsolatorio/covid-bing-query-gpt4-avs_triplets.astro-llms-full-query-data
AstroLLMs Full Query Dataset
This dataset includes all of the data collected in a four-week deployment of a Large Language Model-powered Slack chatbot trained on astrophysics papers. Astronomers were invited to interact with the chatbot, ask questions, and leave feedback. This data includes 368 question-answer pairs, including feedback, reactions, and labeling.
Dataset Structure
The columns of this dataset are thread_ts (unique time stamp of the query), channel_id… See the full description on the dataset page: https://huggingface.co/datasets/jhu-clsp/astro-llms-full-query-data.query_refinement_datasetlogseq-query-clojure-bigquery-embedding-mix-word-mix
🌐 [ACL 2026] Query Embedding Mix Word-Mix Query Bundles
Tongyao Zhu, Chao-Ming Huang, and Min-Yen Kan
This dataset packages the word-mix validation artifacts released with the ACL 2026 study.This dataset repository accompanies our ACL 2026 paper on mixed-language queries in multilingual dense retrieval. It packages the word-level code-mixed query bundles used in the appendix validation workflow, where word-mix is used as a probe to check whether embedding-level… See the full description on the dataset page: https://huggingface.co/datasets/hcm777/query-embedding-mix-word-mix.wildchat-reconstructed-query-unique