datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
mmlu-redux-2.0-for-llama.cppMMLU-redux-v2.0 converted for the llama.cpp perplexity multiple choice tool.
Only valid entries where kept, there is no error based prompting included.
Dataset Card for MMLU-Redux-2.0
MMLU-Redux is a subset of 5,700 manually re-annotated questions across 57 MMLU subjects.
Citation
BibTeX:
@misc{gema2024mmlu,
title={Are We Done with MMLU?},
author={Aryo Pradipta Gema and Joshua Ong Jun Leang and Giwon Hong and Alessio Devoto and Alberto Carlo Maria… See the full description on the dataset page: https://huggingface.co/datasets/Green-Sky/mmlu-redux-2.0-for-llama.cpp.mmlu-redux-for-llama.cppMMLU-redux converted for the llama.cpp perplexity multiple choice tool.
Only valid entries where kept, there is no error based prompting included.
Dataset Card for MMLU-Redux
[!TIP]
Please consider using MMLU-Redux-2.0 which contains all 57 MMLU subjects.
MMLU-Redux is a subset of 3,000 manually re-annotated questions across 30 MMLU subjects.
Citation
BibTeX:
@misc{gema2024mmlu,
title={Are We Done with MMLU?},
author={Aryo Pradipta Gema and Joshua Ong… See the full description on the dataset page: https://huggingface.co/datasets/Green-Sky/mmlu-redux-for-llama.cpp.oa_cpp_annotate_gen
Dataset Description
This dataset, compiled by Brendan Dolan-Gavitt, contains ~100 thousand c++ functions and GPT-3.5 turbo-generated summaries of the code's purpose.
An example of Brendan's original prompt and GPT-3.5's summary may be found below.
int gg_set_focus_pos(gg_widget_t *widget, int x, int y) {
return 1;
}
Q. What language is the above code written in?
A. C/C++.
Q. What is the purpose of the above code?
A.
This code defines a function called `gg_set_focus_pos` that… See the full description on the dataset page: https://huggingface.co/datasets/casey-martin/oa_cpp_annotate_gen.LongBench-v2-for-llama.cppLongBench v2 converted for the llama.cpp perplexity multiple choice tool.
[!WARNING]
!! Currently does not work, will fix it in the near future. Probably.
LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitasks
🌐 Project Page: https://longbench2.github.io
💻 Github Repo: https://github.com/THUDM/LongBench
📚 Arxiv Paper: https://arxiv.org/abs/2412.15204
LongBench v2 is designed to assess the ability of LLMs to handle long-context problems… See the full description on the dataset page: https://huggingface.co/datasets/Green-Sky/LongBench-v2-for-llama.cpp.CPP-Code-Solutions
C++ Code Solutions
Features
1000k of Python Code Solutions for Text Generation and Question Answering
C++ Coding Problems labelled by topic and difficulty
Recommendations
Train your Model on Logical Operations and Mathematical Problems Before Training it on this. This is optional for Fine Tuning 2B parameter + models.
Format the prompts in a orderly way when formatting data eg. {question} Solution: {solution} Topic: {topic}
Stack2Graph_VD_cpp
C++ StackOverflow Vector Dataset
Summary
This Hugging Face dataset repository contains the C++ shard of the Stack2Graph vector-database component as restorable Qdrant artifacts plus portable Parquet fallback files.
Hugging Face uses one dataset repository per programming language, so this repository is directly cloneable without an extra top-level archive wrapper.
The artifacts are intended for semantic and hybrid retrieval, graph entry-point finding, and… See the full description on the dataset page: https://huggingface.co/datasets/Mo7art/Stack2Graph_VD_cpp.