datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
DeepSWEGym2
Dataset Description
This dataset is a filtered and deduplicated version of a merge containing many high quality SWE datasets, it aims to improve benchmark results on DeepSWE-style problems, benchmarks, and general coding skills.
It is specifically filtered for rows with complex/long code problems in the original datasets, having an average row size of 214.19kb, a total uncompressed size of 17.56GB, and a total of 85974 examples.
Dataset Details
Curated by:… See the full description on the dataset page: https://huggingface.co/datasets/MoreThought/DeepSWEGym2.DeepSWEGym2-Ultra
Dataset Description
This dataset is an EXTREMELY filtered and deduplicated version of DeepSWE-Gym2-Edu, it aims to improve benchmark results on DeepSWE-style problems, benchmarks, and general coding skills.
It is specifically filtered for rows with complex/long code problems in the original datasets, having an average row size of 8.27MB, a total uncompressed size of 8.27GB, and a total of 1000 examples.
Dataset Details
Curated by: MoreThought
Funded by:… See the full description on the dataset page: https://huggingface.co/datasets/MoreThought/DeepSWEGym2-Ultra.DeepSWEGym2-Edu
Dataset Description
This dataset is a filtered and deduplicated version of a merge containing many high quality SWE datasets, it aims to improve benchmark results on DeepSWE-style problems, benchmarks, and general coding skills.
It is specifically filtered for rows with complex/long code problems in the original datasets, having an average row size of 291.74kb, a total uncompressed size of 14.93GB, and a total of 53649 examples.
Dataset Details
Curated by:… See the full description on the dataset page: https://huggingface.co/datasets/MoreThought/DeepSWEGym2-Edu.DeepSWEGym2-Full
Dataset Description
This dataset is a merge containing many high quality SWE datasets, it aims to improve benchmark results on DeepSWE-style problems, benchmarks, and general coding skills.
It is NOT specifically filtered for rows with complex/long code problems in the original datasets, despite still having an average row size of 169.08kb, a total uncompressed size of 19.80GB, and a total of 122791 examples.
Dataset Details
Curated by: MoreThought
Funded by:… See the full description on the dataset page: https://huggingface.co/datasets/MoreThought/DeepSWEGym2-Full.DeepSWEGym-Edu
Dataset Description
This dataset is a heavily filtered version of all the SWE-bench/SWE-smith-lang datasets (expect php) merged together (originally 88k rows total), it aims to improve benchmark results on DeepSWE-style problems, benchmarks, and general coding skills.
It is specifically filtered for rows with very complex/long code problems in the original datasets, having an average row size of 101.81kb, a total uncompressed size of 4.29GB, and 42529 examples total.… See the full description on the dataset page: https://huggingface.co/datasets/MoreThought/DeepSWEGym-Edu.DeepSWEGym-Full
Dataset Description
This dataset is a merged version of all the SWE-bench/SWE-smith-lang datasets (88k rows total), it aims to improve benchmark results on DeepSWE-style problems, benchmarks, and general coding skills.
It is NOT specifically filtered for rows with complex/long code problems in the original datasets, despite still having an average row size of 85.4kb, a total uncompressed size of 7.53GB, and 88130 examples total.
Dataset Details
Curated by:… See the full description on the dataset page: https://huggingface.co/datasets/MoreThought/DeepSWEGym-Full.DeepSWE-Agent-Kimi-K2-Trajectories-2.8Kdeepswe-mini
deepswe-mini
16 of the 113 tasks in DeepSWE v1.1, picked so that running just these ranks models the same way the full benchmark does.
DeepSWE is a good benchmark and an expensive one. Every task is a long-horizon feature request in its own container, and a full pass takes close to two days of agent time run one task at a time. If you are comparing models, agent harnesses or prompts, and the differences you care about are more than a few points, these 16 tasks give you the same… See the full description on the dataset page: https://huggingface.co/datasets/LocalLLaMA/deepswe-mini.DeepSWE-Agent-Kimi-K2-Trajectories-Rejection-Sampling