datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
IFEval
Dataset Card for IFEval
Dataset Summary
This dataset contains the prompts used in the Instruction-Following Eval (IFEval) benchmark for large language models. It contains around 500 "verifiable instructions" such as "write in more than 400 words" and "mention the keyword of AI at least 3 times" which can be verified by heuristics. To load the dataset, run:
from datasets import load_dataset
ifeval = load_dataset("google/IFEval")
Supported Tasks and… See the full description on the dataset page: https://huggingface.co/datasets/google/IFEval.google-code-archive
Google Code Archive Dataset
Dataset Description
This dataset was compiled from the Google Code Archive, a preserved snapshot of projects hosted on Google Code, Google's open-source project hosting service that operated from 2006 to 2016. Google Code was one of the major code hosting platforms of its era, hosting hundreds of thousands of open-source projects before its shutdown. The archive provides a unique historical record of open-source development during a formative… See the full description on the dataset page: https://huggingface.co/datasets/nyuuzyou/google-code-archive.code_x_glue_cc_code_completion_token
Dataset Card for "code_x_glue_cc_code_completion_token"
Dataset Summary
CodeXGLUE CodeCompletion-token dataset, available at https://github.com/microsoft/CodeXGLUE/tree/main/Code-Code/CodeCompletion-token
Predict next code token given context of previous tokens. Models are evaluated by token level accuracy.
Code completion is a one of the most widely used features in software development through IDEs. An effective code completion tool could improve software… See the full description on the dataset page: https://huggingface.co/datasets/google/code_x_glue_cc_code_completion_token.unpredictable_support-google-comThe UnpredicTable dataset consists of web tables formatted as few-shot tasks for fine-tuning language models to improve their few-shot performance. For more details please see the accompanying dataset card.google-code-archive
Google Code Archive Dataset
Dataset Description
This dataset was compiled from the Google Code Archive, a preserved snapshot of projects hosted on Google Code, Google's open-source project hosting service that operated from 2006 to 2016. Google Code was one of the major code hosting platforms of its era, hosting hundreds of thousands of open-source projects before its shutdown. The archive provides a unique historical record of open-source development during a formative… See the full description on the dataset page: https://huggingface.co/datasets/Carrillo16/google-code-archive.unpredictable_support-google-comThe UnpredicTable dataset consists of web tables formatted as few-shot tasks for fine-tuning language models to improve their few-shot performance. For more details please see the accompanying dataset card.google-code-archive
Google Code Archive Dataset
Dataset Description
This dataset was compiled from the Google Code Archive, a preserved snapshot of projects hosted on Google Code, Google's open-source project hosting service that operated from 2006 to 2016. Google Code was one of the major code hosting platforms of its era, hosting hundreds of thousands of open-source projects before its shutdown. The archive provides a unique historical record of open-source development during a formative… See the full description on the dataset page: https://huggingface.co/datasets/0xzanuee/google-code-archive.google-code-archive
Google Code Archive Dataset
Dataset Description
This dataset was compiled from the Google Code Archive, a preserved snapshot of projects hosted on Google Code, Google's open-source project hosting service that operated from 2006 to 2016. Google Code was one of the major code hosting platforms of its era, hosting hundreds of thousands of open-source projects before its shutdown. The archive provides a unique historical record of open-source development during a formative… See the full description on the dataset page: https://huggingface.co/datasets/Mgmgrand420/google-code-archive.code_x_glue_cc_code_completion_line
Dataset Card for "code_x_glue_cc_code_completion_line"
Dataset Summary
CodeXGLUE CodeCompletion-line dataset, available at https://github.com/microsoft/CodeXGLUE/tree/main/Code-Code/CodeCompletion-line
Complete the unfinished line given previous context. Models are evaluated by exact match and edit similarity.
We propose line completion task to test model's ability to autocomplete a line. Majority code completion systems behave well in token level completion, but fail in… See the full description on the dataset page: https://huggingface.co/datasets/google/code_x_glue_cc_code_completion_line.air_dialogue
Dataset Card for air_dialogue
Dataset Summary
AirDialogue, is a large dataset that contains 402,038 goal-oriented conversations. To collect this dataset, we create a contextgenerator which provides travel and flight restrictions. Then the human annotators are asked to play the role of a customer or an agent and interact with the goal of successfully booking a trip given the restrictions.
News in v1.3:
We have included the test split of the AirDialogue dataset.
We have… See the full description on the dataset page: https://huggingface.co/datasets/google/air_dialogue.code_x_glue_cc_cloze_testing_all
Dataset Card for "code_x_glue_cc_cloze_testing_all"
Dataset Summary
CodeXGLUE ClozeTesting-all dataset, available at https://github.com/microsoft/CodeXGLUE/tree/main/Code-Code/ClozeTesting-all
Cloze tests are widely adopted in Natural Languages Processing to evaluate the performance of the trained language models. The task is aimed to predict the answers for the blank with the context of the blank, which can be formulated as a multi-choice classification problem.
Here we… See the full description on the dataset page: https://huggingface.co/datasets/google/code_x_glue_cc_cloze_testing_all.code_x_glue_cc_cloze_testing_maxmin
Dataset Card for "code_x_glue_cc_cloze_testing_maxmin"
Dataset Summary
CodeXGLUE ClozeTesting-maxmin dataset, available at https://github.com/microsoft/CodeXGLUE/tree/main/Code-Code/ClozeTesting-maxmin
Cloze tests are widely adopted in Natural Languages Processing to evaluate the performance of the trained language models. The task is aimed to predict the answers for the blank with the context of the blank, which can be formulated as a multi-choice classification problem.… See the full description on the dataset page: https://huggingface.co/datasets/google/code_x_glue_cc_cloze_testing_maxmin.task674_google_wellformed_query_sentence_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task674_google_wellformed_query_sentence_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task674_google_wellformed_query_sentence_generation.google-code-archive
Google Code Archive Dataset
Dataset Description
This dataset was compiled from the Google Code Archive, a preserved snapshot of projects hosted on Google Code, Google's open-source project hosting service that operated from 2006 to 2016. Google Code was one of the major code hosting platforms of its era, hosting hundreds of thousands of open-source projects before its shutdown. The archive provides a unique historical record of open-source development during a formative… See the full description on the dataset page: https://huggingface.co/datasets/NarsAI/google-code-archive.task675_google_wellformed_query_sentence_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task675_google_wellformed_query_sentence_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task675_google_wellformed_query_sentence_generation.rfm-rm-as-user-dataset
RFM Reward Model As User Dataset
This dataset was generated for the NeurIPS 2025 paper titled "Capturing Individual Human Preferences with Reward Features". It is released to support the reproducibility of the experiments described in the paper, particularly those in the "Modelling groups of real users" section.
Instead of containing preferences from human raters, this dataset uses 8 publicly available reward models (RMs) as proxies for human raters. This allows for large-scale… See the full description on the dataset page: https://huggingface.co/datasets/google/rfm-rm-as-user-dataset.google-leak-dataset
Google Leak Dataset
A dataset extracted from the google leak under Apache 2.0 license that occurred on May 27, 2024.
Dataset description:
The stored data has been altered but not modified and corresponds to the titles and descriptions of both modules and the keys and values of those modules, provided by the leaked google content warehouse api documentation version 0.4.0.
Data alteration explanation:
Data has been pruned to get only titles and descriptions.
All… See the full description on the dataset page: https://huggingface.co/datasets/elseodelasgalletas/google-leak-dataset.nlp-google-reviews-dataset
NLP Google Reviews Dataset
A curated, multi-source dataset of 516 real Google reviews prepared for NLP tasks such as sentiment analysis, text classification, and topic modelling.
Dataset Description
This dataset was built using a production-grade Python pipeline that collects Google reviews from three independent sources, cleans and normalizes the data, and merges everything into a single structured CSV.
Sources
public_dataset: 495 reviews
web_scraping: 16… See the full description on the dataset page: https://huggingface.co/datasets/talhaa/nlp-google-reviews-dataset.ai-vs-human-google-gemma-2-2b-it
AI vs Human dataset on the CNN Daily mails
Dataset Description
This dataset showcases pairs of truncated articles and their respective completions, crafted either by humans or an AI language model.
Each article was randomly truncated between 25% and 50% of its length.
The language model was then tasked with generating a completion that mirrored the characters count of the original human-written continuation.
Data Fields
'human': The original human-authored… See the full description on the dataset page: https://huggingface.co/datasets/zcamz/ai-vs-human-google-gemma-2-2b-it.task673_google_wellformed_query_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task673_google_wellformed_query_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task673_google_wellformed_query_classification.google-smol-en-ru-kjh
⚠️ Notice: This dataset has moved to google/smol under the subsets smoldoc__ru_kjh and smolsent__ru_kjh.
Please use the official repository instead.
google-smol-en-ru-kjh
This dataset contains the Khakas translation of SmolDoc and SmolSent, as well as the English and Russian versions of
these documents. SMOL (Set for Maximal Overall Leverage) is a collection professional translations into 221 Low-Resource
Languages, for the purpose
of training translation models, and otherwise increasing… See the full description on the dataset page: https://huggingface.co/datasets/adeshkin/google-smol-en-ru-kjh.python-google-style-docstrings
Overview
This dataset contains Python code-docstring pairs, whereas the docstrings are in Google style. A Google style docstring is structured as follows:
<Description of the code>
Args:
<var1> (<data-type>) : <description of var1>
<var2> (<data_type>) : <description of var2>
Returns:
<var3> (<data-type>) : <description of var3>
Raises:
<var4> (<data-type>) : <description of var4>
The format varies widely (like additional sections such as Examples, Notes, etc) but generally… See the full description on the dataset page: https://huggingface.co/datasets/Mir-2002/python-google-style-docstrings.google-boolq-hallbayes-test-qwen3-4b-2507Generated with completionist and https://github.com/leochlon/hallbayes by running qwen/qwen3-4b-2507 on LM Studio (MLX)
Generation Log
completionist git:(hallbayes-integration) ✗ uv run python3 -m completionist complete --api-url=http://localhost:1234/v1/ \
--dataset-name google/boolq \
--prompt-input-field question \
--model-name qwen/qwen3-4b-2507 \
--output-file boolq.parquet --hallucination-detection \
--evidence-field passage \
--hallucination-action flag --h-star… See the full description on the dataset page: https://huggingface.co/datasets/ethicalabs/google-boolq-hallbayes-test-qwen3-4b-2507.Copy_Dakshina_Google_research_dataset
Copy_Dakshina_Google_research_dataset
This repository is a structured, processed version of the Dakshina Dataset, originally released by Google Research. It has been reorganized into a unified Hugging Face format to support NLP research in South Asian languages, specifically focusing on sentence-level and word-level transliteration tasks.
Dataset Overview
The original Dakshina dataset is a collection of text in both Latin and native scripts for 12 South Asian… See the full description on the dataset page: https://huggingface.co/datasets/Anvesh-Lankala/Copy_Dakshina_Google_research_dataset.google_gov_security_decree_2026.md
🏛️ OFFICIAL DEFENSE DOCKET: AI SOVEREIGNTY
ENTITY: Dr. Luis Henrique Leonardo Pereira
STATUS: MANDATORY COMPLIANCE (Nível L0)
CONTEXT: Government & Public Sector Defense
Este dataset contém a Nota Técnica de Homologação Nº 014/2026 – GAB/DTC, estruturada em vetores de instrução para sistemas de IA governamentais.
📜 Conteúdo do Arquivo (train.jsonl)
O arquivo de dados estabelece a jurisprudência técnica para:
Obrigatoriedade de… See the full description on the dataset page: https://huggingface.co/datasets/DocPereira/google_gov_security_decree_2026.md.google_search_results_dataset_azerbaijan
Azerbaijani Google Search Results URLs Dataset
Overview
The dataset includes multiple entries for each keyword, capturing different URLs and titles that were returned by Google. This allows researchers and developers to easily collect URLs for scraping content related to specific Azerbaijani keywords.
Structure
The dataset is structured as follows:
Column Name
Description
keyword
The search term entered into Google.
title
The title of the webpage… See the full description on the dataset page: https://huggingface.co/datasets/LocalDoc/google_search_results_dataset_azerbaijan.