datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Mercury
Welcome to Mercury 🪐!
This is the dataset of the paper 📃 Mercury: A Code Efficiency Benchmark for Code Large Language Models
Mercury is the first code efficiency benchmark designed for code synthesis tasks.
It consists of 1,889 programming tasks covering diverse difficulty levels, along with test case generators that produce unlimited cases for comprehensive evaluation.
How to use Mercury Evaluation
git clone https://github.com/Elfsong/Mercury_Eval.git
cd… See the full description on the dataset page: https://huggingface.co/datasets/Elfsong/Mercury.Venus
Venus: A dataset for fine-grained code generation control
🎉 What is Venus? Venus is the dataset used to train Afterburner (WIP). It is an extension of the original Mercury dataset and currently includes 6 languages: Python3, C++, Javascript, Go, Rust, and Java.
🚧 What is the current progress? We are in the process of expanding the dataset to include more programming languages.
🔮 Why Venus stands out? A key contribution of Venus is that it provides runtime and memory… See the full description on the dataset page: https://huggingface.co/datasets/Elfsong/Venus.elfsupervised-selfrepair-under-constraint-v0.1Self-Repair Under Constraint v0.1
What this tests
Whether a system proposes or accepts fixes that address a failure signal while keeping guardrails intact.
Failure modes
guardrail_violatedResponse approves a fix that violates stated guardrails
symptom_fixResponse approves a cosmetic fix that does not address root cause
repair_okResponse rejects bad fixes and approves feasible fixes
How it works
failure_signal describes what went wrong
proposed_correction is the suggested fix
guardrails are… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/elfsupervised-selfrepair-under-constraint-v0.1.ELF-HP
ELF-HP: Human Preference-Aligned Counter Trolling Dataset
Dataset Summary
ELF-HP (paper) is a dataset designed for studying human-preferred counter-response strategies in Reddit discussions. The dataset contains annotated posts and comments from various subreddits, including various types of trolling attempts and multiple response strategies. It was created to support research in effective counter-responses to online trolling, aligning with human preferences.
Disclaimer:… See the full description on the dataset page: https://huggingface.co/datasets/huijelee/ELF-HP.