datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
IFEval
Dataset Card for IFEval
Dataset Summary
This dataset contains the prompts used in the Instruction-Following Eval (IFEval) benchmark for large language models. It contains around 500 "verifiable instructions" such as "write in more than 400 words" and "mention the keyword of AI at least 3 times" which can be verified by heuristics. To load the dataset, run:
from datasets import load_dataset
ifeval = load_dataset("google/IFEval")
Supported Tasks and… See the full description on the dataset page: https://huggingface.co/datasets/google/IFEval.wmt24pp
WMT24++
This repository contains the human translation and post-edit data for the 55 en->xx language pairs released in
the publication
WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects.
If you are interested in the MT/LLM system outputs and automatic metric scores, please see MTME.
If you are interested in the images of the source URLs for each document, please see here.
Schema
Each language pair is stored in its own jsonl file.
Each row… See the full description on the dataset page: https://huggingface.co/datasets/google/wmt24pp.spiqa
SPIQA Dataset Card
Dataset Details
Dataset Name: SPIQA (Scientific Paper Image Question Answering)
Paper: SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers
Github: SPIQA eval and metrics code repo
Dataset Summary: SPIQA is a large-scale and challenging QA dataset focused on figures, tables, and text paragraphs from scientific research papers in various computer science domains. The figures cover a wide variety of plots… See the full description on the dataset page: https://huggingface.co/datasets/google/spiqa.mobile-actions
Mobile Actions: A Dataset for On-Device Function Calling
The dataset contains conversational traces designed to train lightweight models (such as FunctionGemma 270M) to translate natural language instructions into executable function calls for Android OS system tools.
Dataset Format
The dataset is provided in JSONL format. Each line represents a data sample. The
dataset is pre-split into training and evaluation sets. This distinction is
denoted by the metadata field… See the full description on the dataset page: https://huggingface.co/datasets/google/mobile-actions.that-one-google-math-datasetapolocheese for poor format, it's because I Don't Care (i'm tired and still working)
data from: https://github.com/google-deepmind/mathematics_dataset
from huggingface_hub import snapshot_download
from datasets import load_dataset
import os
def get_all_files(directory):
file_paths = []
for root, dirs, files in os.walk(directory):
for name in files:
full_path = os.path.join(root, name)
file_paths.append(os.path.abspath(full_path))
return file_paths… See the full description on the dataset page: https://huggingface.co/datasets/midwestern-simulation/that-one-google-math-dataset.google-play-reviewred_ace_asr_error_detection_and_correction
RED-ACE
Dataset Summary
This dataset can be used to train and evaluate ASR Error Detection or Correction models. It was introduced in the RED-ACE paper (Gekhman et al, 2022).
The dataset contains ASR outputs on the LibriSpeech corpus (Panayotov et al., 2015) with annotated transcription errors.
Dataset Details
The LibriSpeech corpus was decoded using Google Cloud Speech-to-Text API, with the default and video models.
The word-level confidence was enabled… See the full description on the dataset page: https://huggingface.co/datasets/google/red_ace_asr_error_detection_and_correction.extended_amazon_2023_dataset
Amazon Reviews '23 Extension Dataset
This dataset provides an extension of the Amazon Reviews ’23 Dataset (https://amazon-reviews-2023.github.io/).
Categories Included
Appliances
Clothing_Shoes_and_Jewelry
Sports_and_Outdoors
Videos_Games
Methodology
First, we performed a series of cleaning and data augmentation steps. We removed the small fraction of items where there was not an image, as having an image is critical to answer our research questions.
Another… See the full description on the dataset page: https://huggingface.co/datasets/google/extended_amazon_2023_dataset.google__gemma-2-27b-it-details
Dataset Card for Evaluation run of google/gemma-2-27b-it
Dataset automatically created during the evaluation run of model google/gemma-2-27b-it
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__gemma-2-27b-it-details.google__switch-base-8-details
Dataset Card for Evaluation run of google/switch-base-8
Dataset automatically created during the evaluation run of model google/switch-base-8
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__switch-base-8-details.trueteacher
TrueTeacher
Dataset Summary
This is a large-scale synthetic dataset for training Factual Consistency Evaluation models, introduced in the TrueTeacher paper (Gekhman et al, 2023).
Dataset Details
The dataset contains model-generated summaries of articles from the train split of the CNN/DailyMail dataset (Hermann et al., 2015)
which are annotated for factual consistency using FLAN-PaLM 540B (Chung et al.,2022).
Summaries were generated using summarization… See the full description on the dataset page: https://huggingface.co/datasets/google/trueteacher.google__gemma-7b-details
Dataset Card for Evaluation run of google/gemma-7b
Dataset automatically created during the evaluation run of model google/gemma-7b
The dataset is composed of 78 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 7 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional configuration… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__gemma-7b-details.google__recurrentgemma-9b-it-details
Dataset Card for Evaluation run of google/recurrentgemma-9b-it
Dataset automatically created during the evaluation run of model google/recurrentgemma-9b-it
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__recurrentgemma-9b-it-details.google__gemma-7b-it-details
Dataset Card for Evaluation run of google/gemma-7b-it
Dataset automatically created during the evaluation run of model google/gemma-7b-it
The dataset is composed of 44 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 6 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__gemma-7b-it-details.google__gemma-1.1-7b-it-details
Dataset Card for Evaluation run of google/gemma-1.1-7b-it
Dataset automatically created during the evaluation run of model google/gemma-1.1-7b-it
The dataset is composed of 44 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__gemma-1.1-7b-it-details.ev-count-google-apigoogle-leak-dataset
Google Leak Dataset
A dataset extracted from the google leak under Apache 2.0 license that occurred on May 27, 2024.
Dataset description:
The stored data has been altered but not modified and corresponds to the titles and descriptions of both modules and the keys and values of those modules, provided by the leaked google content warehouse api documentation version 0.4.0.
Data alteration explanation:
Data has been pruned to get only titles and descriptions.
All… See the full description on the dataset page: https://huggingface.co/datasets/elseodelasgalletas/google-leak-dataset.google__recurrentgemma-9b-details
Dataset Card for Evaluation run of google/recurrentgemma-9b
Dataset automatically created during the evaluation run of model google/recurrentgemma-9b
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__recurrentgemma-9b-details.google-translate-camel-aigoogle__gemma-2-2b-it-details
Dataset Card for Evaluation run of gg-hf/gemma-2-2b-it
Dataset automatically created during the evaluation run of model gg-hf/gemma-2-2b-it
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__gemma-2-2b-it-details.SimulationTuning_google_datasetgoogle__gemma-2-2b-details
Dataset Card for Evaluation run of google/gemma-2-2b
Dataset automatically created during the evaluation run of model google/gemma-2-2b
The dataset is composed of 77 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 3 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__gemma-2-2b-details.googlestoreThis dataset is a subset of the Open Assistant dataset, which you can find here: https://huggingface.co/datasets/OpenAssistant/oasst1/tree/main
This subset of the data only contains the highest-rated paths in the conversation tree, with a total of 9,846 samples.
This dataset was used to train Guanaco with QLoRA.
For further information, please see the original dataset.
License: Apache 2.0
google__gemma-2b-details
Dataset Card for Evaluation run of google/gemma-2b
Dataset automatically created during the evaluation run of model google/gemma-2b
The dataset is composed of 44 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 7 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional configuration… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__gemma-2b-details.google__gemma-2-27b-details
Dataset Card for Evaluation run of google/gemma-2-27b
Dataset automatically created during the evaluation run of model google/gemma-2-27b
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__gemma-2-27b-details.google__gemma-2b-it-details
Dataset Card for Evaluation run of google/gemma-2b-it
Dataset automatically created during the evaluation run of model google/gemma-2b-it
The dataset is composed of 44 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__gemma-2b-it-details.google__flan-t5-large-details
Dataset Card for Evaluation run of google/flan-t5-large
Dataset automatically created during the evaluation run of model google/flan-t5-large
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__flan-t5-large-details.google__recurrentgemma-2b-details
Dataset Card for Evaluation run of google/recurrentgemma-2b
Dataset automatically created during the evaluation run of model google/recurrentgemma-2b
The dataset is composed of 39 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 4 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__recurrentgemma-2b-details.google__recurrentgemma-2b-it-details
Dataset Card for Evaluation run of google/recurrentgemma-2b-it
Dataset automatically created during the evaluation run of model google/recurrentgemma-2b-it
The dataset is composed of 39 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/google__recurrentgemma-2b-it-details.Cairo_Google_Earth_Dataset
The Falcon 360° Cairo Google Earth Dataset
Dataset Summary
The Falcon 360° Cairo Google Earth Dataset is an AI-ready satellite imagery dataset created for computer vision and deep learning applications.
The dataset contains RGB satellite image patches generated from Google Earth Level-2A imagery covering Cairo.
Dataset Download
The complete dataset is available from Zenodo:
Direct download:… See the full description on the dataset page: https://huggingface.co/datasets/TheFalcon360/Cairo_Google_Earth_Dataset.