lite
Datasets
All datasets matching “lite”code_generation_liteLiveCodeBench is a temporaly updating benchmark for code generation. Please check the homepage: https://livecodebench.github.io/.SWE-bench_Lite
Dataset Summary
SWE-bench Lite is subset of SWE-bench, a dataset that tests systems’ ability to solve GitHub issues automatically. The dataset collects 300 test Issue-Pull Request pairs from 11 popular Python. Evaluation is performed by unit test verification using post-PR behavior as the reference solution.
The dataset was released as part of SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
Want to run inference now?
This dataset only contains the… See the full description on the dataset page: https://huggingface.co/datasets/princeton-nlp/SWE-bench_Lite.R2E-Gym-LiteSWE-bench_Lite
Dataset Summary
SWE-bench Lite is subset of SWE-bench, a dataset that tests systems’ ability to solve GitHub issues automatically. The dataset collects 300 test Issue-Pull Request pairs from 11 popular Python. Evaluation is performed by unit test verification using post-PR behavior as the reference solution.
The dataset was released as part of SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
Want to run inference now?
This dataset only contains the… See the full description on the dataset page: https://huggingface.co/datasets/SWE-bench/SWE-bench_Lite.Global-MMLU-Lite
Releases:
Version 3.0 (May 2026): GMMLU Lite 3.0 release with 5 new languages: Czech, Hungarian, Italian (updated), Oriya, Slovak and Tajik
Version 2.0 (Dec 2025): GMMLU Lite 2.0 release with 3 new languages: Albanian, Burmese and Welsh
Version 1.0 (Dec 2024): GMMLU Lite initial release with 15 languages.
Dataset Summary
Global-MMLU-Lite is a multilingual evaluation set spanning 23 languages, including English. It is "lite" version of the original Global-MMLU… See the full description on the dataset page: https://huggingface.co/datasets/CohereLabs/Global-MMLU-Lite.SWE-Gym-LiteSWE-Gym Lite contains 230 instances sourced from 11 Python repos, following SWE-Bench Lite data collection procedure.
Get started at project page github.com/SWE-Gym/SWE-Gym
