datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
llm-math-evaluation-dataset
LLM Math Response Evaluation Dataset
Dataset Summary
A human-annotated dataset of 150 AI-generated math responses
evaluated across GPT-4o, Claude, and Gemini. Each response is
scored on Correctness, Reasoning, and Clarity using a structured
rubric, with written justification for every score.
Supported Tasks
LLM evaluation and benchmarking
Math reasoning quality assessment
Error type classification in AI responses
Dataset Structure… See the full description on the dataset page: https://huggingface.co/datasets/nbvbharath-1729/llm-math-evaluation-dataset.llm-commit-message-evaluation
Dataset Card for LLM Commit Message Evaluation
The LLM Commit Message Evaluation dataset is designed to evaluate and compare the performance of Large Language Models (LLMs) in generating high-quality git commit messages. It contains real-world code diffs, issue descriptions, and issue titles extracted from open-source repositories (such as OWASP/Nest).
For each code change, the dataset provides the original human-written commit message alongside commit messages generated by… See the full description on the dataset page: https://huggingface.co/datasets/g-for-gour/llm-commit-message-evaluation.LLM_Response_Eval
LLM Response Evaluation Dataset
This dataset contains a collection of responses generated by three large language models (LLMs): GPT-4o, Gemini 1.5 Pro, and Llama 3.1 405B. The responses are to a series of questions aimed at evaluating the models' problem-solving abilities using Polya's problem-solving technique, as described in the book "How to Solve It" by George Polya.
Dataset Overview
Questions: The dataset includes a set of questions designed to evaluate the… See the full description on the dataset page: https://huggingface.co/datasets/AmirMohseni/LLM_Response_Eval.memefact-llm-evaluations
MemeFact LLM Evaluations Dataset
This dataset contains 7,680 evaluation records where state-of-the-art Large Language Models (LLMs) assessed fact-checking memes according to specific quality criteria. The dataset provides comprehensive insights into how different AI models evaluate visual-textual content and how these evaluations compare to human judgments.
Dataset Description
Overview
The "MemeFact LLM Evaluations" dataset documents a systematic… See the full description on the dataset page: https://huggingface.co/datasets/sergiogpinto/memefact-llm-evaluations.hugging-face-LLM-evaluation-results
Dataset Summary
Data comes from hugging face evaluation results using the https://github.com/EleutherAI/lm-evaluation-harness . See https://huggingface.co/datasets/open-llm-leaderboard/results for full results.
multilingual-llm-evaluation
Multilingual LLM Evaluation
A small evaluation dataset for comparing language models across English, Hindi, and Spanish.
Columns
language: language code (en, hi, or es)
question: question provided to the model
expected_answer: reference answer used for scoring
Intended use
This dataset can be used to compare model accuracy, language adherence, and response speed across languages.
Limitations
This is a small demonstration dataset and… See the full description on the dataset page: https://huggingface.co/datasets/userhuggingface4321/multilingual-llm-evaluation.LLM-EvaluationHub
LLM-EvaluationHub: Enhanced Dataset for Large Language Model Assessment
This repository, LLM-EvaluationHub, presents an enhanced dataset tailored for the evaluation and assessment of Large Language Models (LLMs). It builds upon the dataset originally provided by SafetyBench (THU-COAI), incorporating significant modifications and additions to address specific research objectives. Below is a summary of the key differences and enhancements:
Key Modifications… See the full description on the dataset page: https://huggingface.co/datasets/strikoder/LLM-EvaluationHub.ar-llm-vibe-evalPubmed-RAG-TR-LLM-EvalLLM-as-a-judge evalaution results using "claude-haiku-4-5-20251001" for SMARTICT/Pubmed-RAG-TR-LLM dataset.
llm-reasoning-evaluation-examples
LLM Reasoning Evaluation Examples
Overview
This dataset contains 20 prompts designed to evaluate potential blind spots in a base language model.It covers 10 reasoning categories: Logic, Arithmetic, Factual, Language/Translation, Pattern/Analogy, Commonsense, Comparison, Negation/Uncertainty, Math Sequence, and Analogies.
The dataset is intended for educational and research purposes to illustrate where a base model may produce outputs that differ from expected answers.… See the full description on the dataset page: https://huggingface.co/datasets/hareem-arshad/llm-reasoning-evaluation-examples.llm-pubmed-query-generation-evalLLM_EVAL_Datasetsimple_llm_eval_frameworkBilingual-LLM-Eval-106
Bilingual-LLM-Eval-106
📌 Overview
Bilingual-LLM-Eval-106 is a curated, human-annotated evaluation dataset of 106 LLM response pairs in English and Portuguese, designed to benchmark model performance across multiple quality dimensions.
The dataset focuses on realistic and challenging evaluation scenarios, including adversarial prompts, ambiguous queries, and hard negatives.
It is intended for:
LLM evaluation and benchmarking
LLM-as-a-Judge research
Multilingual… See the full description on the dataset page: https://huggingface.co/datasets/renataaraujoe/Bilingual-LLM-Eval-106.llm_evaluationllm-eval-recipe-impacttoy-llm-eval-dataset