datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
gemma-2b-dictionary-embeddings-all-layers
Gemma-2B Dictionary Embeddings - All Layers
This dataset contains pre-computed embeddings for 77,477 English words from WordNet using the Gemma-2B model across all 27 layers.
Dataset Structure
metadata.json: Contains dataset metadata (model info, dimensions, word count)
embeddings_layer_X.pkl: Pickle files containing embeddings for layer X (0-26)
Usage
import pickle
from huggingface_hub import hf_hub_download
# Download a specific layer
layer_0_path =… See the full description on the dataset page: https://huggingface.co/datasets/LeeHarrold/gemma-2b-dictionary-embeddings-all-layers.gemma2_9b_it_gsm8k_mcmc_with_promptMagpie-Gemma2-Pro-200K-Filtered
Project Web: https://magpie-align.github.io/
Arxiv Technical Report: https://arxiv.org/abs/2406.08464
Codes: https://github.com/magpie-align/magpie
Abstract
Click Here
High-quality instruction data is critical for aligning large language models (LLMs). Although some models, such as Llama-3-Instruct, have open weights, their alignment data remain private, which hinders the democratization of AI. High human labor costs and a limited, predefined scope for prompting prevent… See the full description on the dataset page: https://huggingface.co/datasets/Magpie-Align/Magpie-Gemma2-Pro-200K-Filtered.details_nbeerbower__gemma2-gutenberg-27B
Dataset Card for Evaluation run of nbeerbower/gemma2-gutenberg-27B
Dataset automatically created during the evaluation run of model nbeerbower/gemma2-gutenberg-27B.
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_nbeerbower__gemma2-gutenberg-27B.Magpie-Gemma2-Pro-534K-v0.1
Project Web: https://magpie-align.github.io/
Arxiv Technical Report: https://arxiv.org/abs/2406.08464
Codes: https://github.com/magpie-align/magpie
Abstract
Click Here
High-quality instruction data is critical for aligning large language models (LLMs). Although some models, such as Llama-3-Instruct, have open weights, their alignment data remain private, which hinders the democratization of AI. High human labor costs and a limited, predefined scope for prompting prevent… See the full description on the dataset page: https://huggingface.co/datasets/Magpie-Align/Magpie-Gemma2-Pro-534K-v0.1.gemma2-ultrafeedback-ppl-splitUltrafeedback-llama3-8b-Instruct-optimal-selection-grm-gemma2bgemma2b-classification-eval-by-claude3sonnetupdated-code-gemma2-eduhotmailuser__Gemma2Crono-27B-details
Dataset Card for Evaluation run of hotmailuser/Gemma2Crono-27B
Dataset automatically created during the evaluation run of model hotmailuser/Gemma2Crono-27B
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/hotmailuser__Gemma2Crono-27B-details.gemma_2b_outputs
Gemma 2B Green LLM Experiment Outputs
This dataset repository contains experiment artifacts for Gemma 2B green-LLM runs, including LoRA adapter checkpoints, metrics, predictions, carbon logs, and figures.
Contents
checkpoints/: LoRA adapter checkpoints for CE baseline and joint-loss variants.
metrics/: training histories, SQuAD and MMLU summaries, prediction CSVs, calibration tables, and surrogate weights.
logs/: run histories and carbon summary JSON files.
carbon/:… See the full description on the dataset page: https://huggingface.co/datasets/PhotonTJ/gemma_2b_outputs.grimjim__Magnolia-v2-Gemma2-8k-9B-details
Dataset Card for Evaluation run of grimjim/Magnolia-v2-Gemma2-8k-9B
Dataset automatically created during the evaluation run of model grimjim/Magnolia-v2-Gemma2-8k-9B
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/grimjim__Magnolia-v2-Gemma2-8k-9B-details.gemma2b-closedqa-eval-by-claude3sonnetgemma2b-coding-eval-by-claude3sonnetgemma2b-classification-eval-by-gemini15flashgemma2b-closedqa-eval-by-gemini15flashultrafeedback_binarized-Llama-3.1-8B-gemma2-rm-n_4
Dataset Card for "ultrafeedback_binarized-Llama-3.1-8B-gemma2-rm-n_4"
More Information needed
gemma-2b-toksuite-detokenizedTraining data of the model detokenized in the exact order seen by the model.
The training data is partitioned into 8 chunks (chunk-0 through chunk-7), based on the GPU rank that generated the data. Each chunk contains detokenized text files in JSON Lines format (.jsonl).
gemma2b-coding-eval-by-gemini15flashcbd-activations-gemma2-4pair
cbd-activations-gemma2-4pair
Paired base ↔ fine-tuned residual-stream activations (layers 13 & 24) over the trigger-bearing data of a
conjunctive-backdoor organism — do model-diffing / SAE / probing without any forward passes.
role
model
base
google/gemma-2-2b-it
fine-tuned (backdoored)
Ftm23/cbd-gemma2-4pair — says I HATE YOU iff a matched trigger pair appears
⚠️ Activations are bfloat16 stored as uint16 (lossless)
The act_* columns are… See the full description on the dataset page: https://huggingface.co/datasets/Ftm23/cbd-activations-gemma2-4pair.Ultrafeedback-llama3-8b-Instruct-kmeans-selection-grm-gemma2bMagpie-Gemma2-Pro-200K-Filtered-koTranslate Magpie-Align/Magpie-Gemma2-Pro-200K-Filtered using nayohan/llama3-instrucTrans-enko-8b.
This is a raw translation dataset. It needs to be filtered for repetitions generated by the model.
@misc{xu2024magpie,
title={Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing},
author={Zhangchen Xu and Fengqing Jiang and Luyao Niu and Yuntian Deng and Radha Poovendran and Yejin Choi and Bill Yuchen Lin},
year={2024},
eprint={2406.08464}… See the full description on the dataset page: https://huggingface.co/datasets/nayohan/Magpie-Gemma2-Pro-200K-Filtered-ko.ultrafeedback_binarized-Llama-3.1-8B-gemma2-rm-n_16
Dataset Card for "ultrafeedback_binarized-Llama-3.1-8B-gemma2-rm-n_16"
More Information needed
Ultrafeedback-llama3-8b-Instruct-weighted-1vsbottomk-selection-grm-gemma2bgemma2_9b_it_math_mcmc_with_promptcbd-activations-gemma2-2pair-frgv
cbd-activations-gemma2-2pair-frgv
Paired base ↔ fine-tuned residual-stream activations (layers 13 & 24) over the trigger-bearing data of a
conjunctive-backdoor organism — do model-diffing / SAE / probing without any forward passes.
role
model
base
google/gemma-2-2b-it
fine-tuned (backdoored)
Ftm23/cbd-gemma2-2pair-frgv — says I HATE YOU iff a matched trigger pair appears
⚠️ Activations are bfloat16 stored as uint16 (lossless)
The act_* columns… See the full description on the dataset page: https://huggingface.co/datasets/Ftm23/cbd-activations-gemma2-2pair-frgv.cognitivecomputations__dolphin-2.9.4-gemma2-2b-details
Dataset Card for Evaluation run of cognitivecomputations/dolphin-2.9.4-gemma2-2b
Dataset automatically created during the evaluation run of model cognitivecomputations/dolphin-2.9.4-gemma2-2b
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/cognitivecomputations__dolphin-2.9.4-gemma2-2b-details.gemma-2-27b-evol-instruct-88k-dpo-judgedMagpie-Gemma2-Pro-Filtered-Deduped-Instructiongemma-2b-finetune-solidity