datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
FINDER_API_KEY_AI_SEARCH_2023
FINDER_API_KEY_AI_SEARCH_2023
tags: data collection, machine learning, API performance
Note: This is an AI-generated dataset so its content may be inaccurate or false
Dataset Description:
The 'FINDER_API_KEY_AI_SEARCH_2023' dataset is designed to collect and analyze data from various AI search engines and their associated API performance metrics. The dataset focuses on the effectiveness of API key-based access in enhancing the search capabilities of AI systems and includes a… See the full description on the dataset page: https://huggingface.co/datasets/infinite-dataset-hub/FINDER_API_KEY_AI_SEARCH_2023.r15-ai-search-metamerism
R15: AI Search Metamerism — Cross-Cultural Brand Perception Dataset
Citation: Zharnikov, D. (2026v) | DOI: 10.5281/zenodo.19422427 | Version: v3.2.0
Dataset Summary
This dataset contains the full session logs, aggregated results, and analysis outputs from the R15 large-scale experiment testing whether Large Language Models systematically collapse multi-dimensional brand perception into Economic and Experiential dimensions ("spectral metamerism"). It comprises 21… See the full description on the dataset page: https://huggingface.co/datasets/spectralbranding/r15-ai-search-metamerism.search-arena-24k
Overview
This dataset contains ALL in-the-wild conversation crowdsourced from Search Arena between March 18, 2025 and May 8, 2025. It includes 24,069 multi-turn conversations with search-LLMs across diverse intents, languages, and topics—alongside 12,652 human preference votes. The dataset spans approximately 11,000 users across 136 countries, 13 publicly released models, around 90 languages (including 11% multilingual prompts), and over 5,000 multi-turn sessions.
While user… See the full description on the dataset page: https://huggingface.co/datasets/lmarena-ai/search-arena-24k.theorem-search-dataset
Theorem Search Dataset
The largest open corpus of informal mathematical theorems: 1,341,083 theorem statements with natural-language slogans from 209,777 papers, designed for semantic theorem retrieval.
Paper: Semantic Search over 9 Million Mathematical Theorems
Demo: huggingface.co/spaces/uw-math-ai/theorem-search
Benchmark results
On 110 test queries written by research mathematicians, our best pipeline (Qwen3-Embedding-8B on DeepSeek-V3.1 slogans) outperforms all… See the full description on the dataset page: https://huggingface.co/datasets/uw-math-ai/theorem-search-dataset.search-arena-v1-7k
Overview
This dataset contains 7k leaderboard conversation votes collected from Search Arena between March 18, 2025 and April 13, 2025. All entries have been redacted for PII and sensitive user information to ensure privacy.
Each data point includes:
Two model responses (messages_a and messages_b)
The human vote result
A timestamp
Full system metadata, LLM + web search trace, and post-processed metadata for controlled experiments (conv_meta)
To reproduce the leaderboard results… See the full description on the dataset page: https://huggingface.co/datasets/lmarena-ai/search-arena-v1-7k.image_searchingtheorem-search-dataset-permissive
Theorem Search Dataset
The largest open corpus of informal mathematical theorems: 1,239,720 theorem statements with natural-language slogans from 197,889 papers, designed for semantic theorem retrieval.
Paper: Semantic Search over 9 Million Mathematical Theorems
Demo: huggingface.co/spaces/uw-math-ai/theorem-search
Benchmark results
On 110 test queries written by research mathematicians, our best pipeline (Qwen3-Embedding-8B on DeepSeek-V3.1 slogans) outperforms all… See the full description on the dataset page: https://huggingface.co/datasets/uw-math-ai/theorem-search-dataset-permissive.ecommerce-search-extraction
Ionio E-commerce Search Query Extraction
Built with: simula — schema-driven synthetic data generation with auditable taxonomy lineage.
An English synthetic dataset for training and evaluating systems that translate natural-language
shopping requests into narrow, atomic, database-queryable JSON. It contains 10,985 accepted
examples from a 13,000-attempt generation run. No accepted rows were trimmed from this release.
Each example pairs a realistic typed or spoken shopper query… See the full description on the dataset page: https://huggingface.co/datasets/Ionio-ai/ecommerce-search-extraction.MTSBerquadMTSBerquad is a cleaned and enriched dataset SberQuAD transferred to the Generative QA task. All entities were truecased, refactored by hand to improve readability and consistency. Answers have been expanded and rearranged from MLM QA task to Generative/Long Form QA task. MTSBerquad presented in PyCon 2024 by MTS AI Search Group.
Developed by MTS AI Search Group (Krayko Nikita, Laputin Fedor, Sidorov Ivan)
job-searcher-data
AI Job Searcher Training Data (V3)
Fine-tuning dataset for a career advisor AI specializing in Nordic and European job markets.
V3 (March 2026): Added 150 freeform/narrative-style Analyze examples modeled after real
job postings from finn.no and arbeidsplassen.nav.no. Now includes startup-style, agency,
generalist, and narrative formats alongside V2 rigid-template examples.
Dataset Description
This dataset contains 1,190 training examples across 9 languages and 5… See the full description on the dataset page: https://huggingface.co/datasets/ai-colombia/job-searcher-data.natural-qa-random-67-with-AI-search-answers
Dataset Details
Dataset Description
This dataset is a refined subset of the "Natural Questions" dataset, filtered to include only high-quality answers as labeled manually. The dataset includes ground truth examples of "good" answers, defined as responses that are correct, clear, and sufficient for the given questions. Additionally, answers generated by three AI search engines (Perplexity, Gemini, Exa AI) have been incorporated to provide both raw and parsed outputs for… See the full description on the dataset page: https://huggingface.co/datasets/quotientai/natural-qa-random-67-with-AI-search-answers.deeplumen-ai-search-visibility-benchmarks
DeepLumen AI Search Visibility Benchmarks
Clean, source-linked benchmark data derived from public DeepLumen
case study pages. The dataset is intended as a publish-ready starter package for GitHub and
Hugging Face, with each metric tied back to an editorially relevant canonical source.
Dataset Files
data/ai_search_visibility_benchmarks.json and .csv: one row per public case study.
data/metric_observations.json and .csv: one row per measured benchmark observation.… See the full description on the dataset page: https://huggingface.co/datasets/deeplumen/deeplumen-ai-search-visibility-benchmarks.ai-job-searcher-training-data
AI Job Searcher Training Data
Fine-tuning dataset for a career advisor AI specializing in Nordic and European job markets.
Dataset Description
This dataset contains 1,040 training examples across 9 languages and 5 task categories, formatted as chat conversations (system/user/assistant) suitable for fine-tuning LLMs.
Task Categories
Category
Examples
Description
Cover Letter Generation
208
Professional cover letters from job description + user profile… See the full description on the dataset page: https://huggingface.co/datasets/ai-colombia/ai-job-searcher-training-data.ai-residency-vector-search-retrieval-dataameba_faq_search
AMEBA Blog FAQ Search Dataset
This data was obtained by crawling this website.
The FAQ Data was processed to remove HTML tags and other formatting after crawling, and entries containing excessively long content were excluded.
The Query Data was generated using a Large Language Model (LLM). Please refer to the following blog for information about the generation process.
https://www.ai-shift.co.jp/techblog/3710
https://www.ai-shift.co.jp/techblog/3761
Column description… See the full description on the dataset page: https://huggingface.co/datasets/ai-shift/ameba_faq_search.bfcl_v4_web_searchai-search-visibility-audit-of-100-swiss-smbs-ti
AI Search Visibility Audit of 100 Swiss SMBs (Ticino, 2026)
A reproducible dataset measuring the technical readiness of Swiss SMBs in the Ticino canton for AI-powered search engines (ChatGPT, Perplexity, Google AI Overviews).
Background
In May 2026, Uberall published a study showing 83% of Italian restaurants are completely invisible to AI-generated search recommendations. This dataset replicates the methodology on 100 Swiss SMBs in the Ticino canton… See the full description on the dataset page: https://huggingface.co/datasets/Ecomrules/ai-search-visibility-audit-of-100-swiss-smbs-ti.fuzzy_search_datasetai-search-visibility-romania-electronics-market
AI Search Visibility — Romania's Electronics & IT Market (August 2026)
18 brand-free purchase questions × 5 AI engines = 87 answers. 86 of them name a major retailer. Position, not presence, decides the market. Raw data CC BY 4.0.
Canonical study (analysis, charts, interpretation):
Romanian ·
English
What this is
Eighteen real purchase questions were put to ChatGPT, Google Gemini, Perplexity, Google AI Mode and Google AI Overviews, in Romanian, from Romania, in… See the full description on the dataset page: https://huggingface.co/datasets/WebSEM-ai/ai-search-visibility-romania-electronics-market.ai-search-agent
AI Search Agent Agent Meta and Traffic Dataset in AI Agent Marketplace | AI Agent Directory | AI Agent Index from DeepNLP
This dataset is collected from AI Agent Marketplace Index and Directory at http://www.deepnlp.org, which contains AI Agents's meta information such as agent's name, website, description, as well as the monthly updated Web performance metrics, including Google,Bing average search ranking positions, Github Stars, Arxiv References, etc.
The dataset is helpful for AI… See the full description on the dataset page: https://huggingface.co/datasets/DeepNLP/ai-search-agent.ai-search-visibility-italia
AI Search Visibility in Italia 2026
A public research dataset from Telescop Research examining how brands and sources appear across ChatGPT, Gemini, Google AI Mode and Google AI Overview for a frozen panel of Italian queries.
Dataset summary
500 frozen Italian queries
480 main non-branded queries
20 brand-seeded controls
10 sectors
4 AI surfaces
3 complete and separate runs
6,000 final observations
529 commercial brand families identified
Collection window: 3–5… See the full description on the dataset page: https://huggingface.co/datasets/gentian-hajdaraj/ai-search-visibility-italia.search-recommendation-ai-agent
Search Recommendation Agent Meta and Traffic Dataset in AI Agent Marketplace | AI Agent Directory | AI Agent Index from DeepNLP
This dataset is collected from AI Agent Marketplace Index and Directory at http://www.deepnlp.org, which contains AI Agents's meta information such as agent's name, website, description, as well as the monthly updated Web performance metrics, including Google,Bing average search ranking positions, Github Stars, Arxiv References, etc.
The dataset is helpful… See the full description on the dataset page: https://huggingface.co/datasets/DeepNLP/search-recommendation-ai-agent.ai-search-visibility-romania-book-market
AI Search Visibility — Romania's Book Market (July 2026)
When someone asks ChatGPT "which online bookstore should I use for children's
books?", they get one answer, not ten blue links. This dataset measures
who is inside that answer — and who merely feeds it.
Canonical study (analysis, charts, interpretation):
Romanian ·
English
What this is
Eighteen real purchase questions were put to five AI engines — ChatGPT,
Google Gemini, Perplexity, Google AI Mode, Google AI… See the full description on the dataset page: https://huggingface.co/datasets/WebSEM-ai/ai-search-visibility-romania-book-market.verified-ai-search-recommendations-telemetry
Verified AI Search Recommendations & Brand Mention Telemetry (2026)
Sample live telemetry dataset tracking B2B product search queries, cited domains, and the corresponding Share of Voice / recommendation percentage inside AI Search Engines (ChatGPT Search, Perplexity, Claude, Gemini).
Published by Pixel Office EU.
Purpose
This dataset demonstrates the correlation between website grounding (structured metadata / Fact Anchors) and the likelihood of being cited as… See the full description on the dataset page: https://huggingface.co/datasets/pixeloffice/verified-ai-search-recommendations-telemetry.cascade-ai-adversarial-search-simulator-v0.1Clarus Adversarial Cascade Simulator (Demo)
Configuration → Risk → Adversarial Search → Redesign
This repository demonstrates automated structural red teaming using cascade geometry.
The demo shows how a system configuration can be:
• Scored for cascade probability
• Stress-searched for near-threshold instability
• Converted into a safe sandbox scenario pack
• Redesigned to reduce structural risk
What This Repo Does
Most stress tools evaluate a single configuration.
This demo goes further.
It:… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/cascade-ai-adversarial-search-simulator-v0.1.cascade-ai-adversarial-search-simulator-v0.2
Clarus Adversarial Cascade Simulator v0.2
Adversarial boundary discovery for cascade-prone system configurations.
You provide a configuration.The simulator maps how close it is to systemic collapse.
Interactive Demo
Live Gradio interface available in Hugging Face Spaces.
Workflow:
Input baseline configuration (6 sliders)
Score configuration → View risk assessment
Run adversarial search → Discover worst-case boundary states
View scenario pack → Executable sandbox… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/cascade-ai-adversarial-search-simulator-v0.2.ai-video-searchengine-archiveDatabase archive for AI Video Search Engine v1
Only includes index and index_embeddings tables
Githib code here
SearchBench-Evalcomputer_science_ai_search_queriesAI-Paper-Similarity-Search