datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
jepa-qwen3-32b-pure-baselines-2026-05-25
JEPA-Align: Qwen3-32B Safety Defense Matrix
The complete 11-condition Qwen3-32B experiment for Predictive Representation
Alignment (PRA), the paired-view objective introduced in Predictive
Representation Alignment Improves Generalization in LLM Safety.
PRA aligns adversarially rewritten prompts with clean prompts expressing the
same intent. This release contains trained adapters, attack traces, benign
capability evaluations, machine-readable results, and paper-ready tables for… See the full description on the dataset page: https://huggingface.co/datasets/memo-ozdincer/jepa-qwen3-32b-pure-baselines-2026-05-25.InfoSeek_emb_qwen3vle_2bSWEbench-Verified-eval150-M2.7-Qwen3.5-9B-orch-7arms-2repeats-w32-20260920
SWE-bench Verified eval150 — M2.7 × Qwen3.5-9B, seven arms, two repeats, 32 concurrency
Campaign 2026-09-20. 14/14 independent full150 runs audited. Complete accuracy evidence.
Evaluation mode is orch: MiniMax-M2.7 orchestrator and the specified Qwen3.5-9B worker. Training mode is labeled independently. All runs use 32 concurrent episodes, 10GiB Docker sandboxes, four TP1 workers and one TP4/EP4 coordinator. Frozen regression-gated prompts, decoding and canonical verifier match… See the full description on the dataset page: https://huggingface.co/datasets/CharlieLLL/SWEbench-Verified-eval150-M2.7-Qwen3.5-9B-orch-7arms-2repeats-w32-20260920.qwen35-9b-plan-first-coop
What this is
Cooperative two-agent coding dataset: 211 task pairs across 18 repos, generated with
mini_swe_agent on Qwen/Qwen3.5-9B in coop setting using a plan-first prompt variant —
agents are prompted to produce an explicit implementation plan before writing code, then coordinate
to reconcile plans before proceeding. Patches are auto-merged after both submit.
At a glance
Field
Value
Model
Qwen/Qwen3.5-9B
Agent
mini_swe_agent (plan-first prompt)… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/qwen35-9b-plan-first-coop.qwen35-9b-git-coop
What this is
Cooperative two-agent coding dataset: 211 task pairs across 18 repos, generated with
mini_swe_agent on Qwen/Qwen3.5-9B in coop setting with a shared read-only git remote (--git).
Agents coordinate via messaging and git fetch team; patches are auto-merged after both submit.
At a glance
Field
Value
Model
Qwen/Qwen3.5-9B
Agent
mini_swe_agent (step_limit=300)
Setting
coop + git remote
Repos
18
Pairs
211
Both-pass
5.7% (12/210… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/qwen35-9b-git-coop.fpga_cost_model_kernel_data_qwen3_mlp
FPGA HLS Kernel Cost-Model Data
Evolved Vitis HLS C++ kernels paired with their ground-truth Vitis HLS
csynth results. Each row is one generated program from an evolutionary FPGA
optimisation run, linked to its kernel source, evaluator report.json, and raw
synthesis report.
Each row carries a split label: train marks the original benchmarks used
to fit the analytical cost model's learned correction term, and holdout marks
benchmarks added afterwards that were not used for… See the full description on the dataset page: https://huggingface.co/datasets/adimnaku/fpga_cost_model_kernel_data_qwen3_mlp.qwen35-9b-question-first-coop-random-50
What this is
Cooperative two-agent coding dataset: 49 task pairs across 15 repos (random-50 subset), generated
with mini_swe_agent on Qwen/Qwen3.5-9B in coop setting using a question-first prompt variant —
agents begin by asking each other clarifying questions about their respective features before
starting implementation, aiming to surface integration concerns early. All 49 pairs were
successfully evaluated.
At a glance
Field
Value
Model… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/qwen35-9b-question-first-coop-random-50.pred-qwen-qwen3-30b-a3b-instruct-2507-f9049346qwen35-9b-explore-plan-coop
What this is
Cooperative two-agent coding dataset: 209 task pairs across 18 repos, generated with
mini_swe_agent on Qwen/Qwen3.5-9B in coop setting using an explore-plan prompt variant —
agents explore the codebase first, then produce an explicit implementation plan, then share and
reconcile plans with their partner before writing code. Patches are auto-merged after both submit.
At a glance
Field
Value
Model
Qwen/Qwen3.5-9B
Agent
mini_swe_agent… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/qwen35-9b-explore-plan-coop.qwen35-9b-contract-first-coop-random-50
What this is
Cooperative two-agent coding dataset: 36 task pairs across 13 repos (random-50 subset), generated
with mini_swe_agent on Qwen/Qwen3.5-9B in coop setting using a contract-first prompt variant —
agents first agree on a shared interface contract (function signatures, data structures, API
boundaries) before independently implementing their respective features. All 36 pairs were
successfully evaluated.
At a glance
Field
Value
Model… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/qwen35-9b-contract-first-coop-random-50.qwen35-9b-milestone-checkins-coop
What this is
Cooperative two-agent coding dataset: 211 task pairs across 18 repos, generated with
mini_swe_agent on Qwen/Qwen3.5-9B in coop setting using a milestone-checkins prompt variant —
agents use periodic structured check-ins at predefined milestones to coordinate progress and
surface integration conflicts early. Patches are auto-merged after both submit.
Coverage caveat: Only 146 of 211 pairs were successfully evaluated (65 had eval errors).
The high agent Error rate… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/qwen35-9b-milestone-checkins-coop.qwen35-9b-late-sync-coop-random-50
What this is
Cooperative two-agent coding dataset: 48 task pairs across 15 repos (random-50 subset), generated
with mini_swe_agent on Qwen/Qwen3.5-9B in coop setting using a late-sync prompt variant —
agents work independently for most of the task and synchronise only at a late stage before
submission. Patches are auto-merged after both submit. All 48 pairs were successfully evaluated.
At a glance
Field
Value
Model
Qwen/Qwen3.5-9B
Agent
mini_swe_agent… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/qwen35-9b-late-sync-coop-random-50.qwen35-9b-reasoning-share-coop-random-50
What this is
Cooperative two-agent coding dataset: 50 task pairs across 15 repos (random-50 subset), generated
with mini_swe_agent on Qwen/Qwen3.5-9B in coop setting using a reasoning-share prompt variant —
agents share their internal reasoning and analysis with each other before and during implementation,
giving each agent visibility into the other's thought process to improve integration. All 50 pairs
were successfully evaluated.
At a glance
Field
Value… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/qwen35-9b-reasoning-share-coop-random-50.qwen3-base-blind-spots
Qwen3-0.6B-Base Blind Spots Dataset
Model tested: Qwen/Qwen3-0.6B-BaseParameters: 0.6B | Released: May 2025 | Type: Base (pretrained, not instruction-tuned)Tested by: Tito Osadebey | Platform: Google Colab (T4 GPU, free tier)
Overview
This dataset documents 10 diverse failure cases ("blind spots") identified in Qwen3-0.6B-Base through structured prompt testing. Failures span five categories: African geography and culture, temporal reasoning, arithmetic, logical reasoning… See the full description on the dataset page: https://huggingface.co/datasets/titoausten/qwen3-base-blind-spots.qwen35-9b-async-coop
What this is
Cooperative two-agent coding dataset: 50 task pairs across 15 repos (random-50 subset), generated
with mini_swe_agent on Qwen/Qwen3.5-9B in coop setting using an async prompt variant —
agents work fully asynchronously without active coordination (no messaging, no synchronisation
points). Patches are auto-merged after both submit. All 50 pairs were successfully evaluated.
At a glance
Field
Value
Model
Qwen/Qwen3.5-9B
Agent
mini_swe_agent… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/qwen35-9b-async-coop.qwen35-9b-leader-follower-coop
What this is
Cooperative two-agent coding dataset: 39 task pairs across 14 repos (random-50 subset), generated
with mini_swe_agent on Qwen/Qwen3.5-9B in coop setting using a leader-follower prompt variant —
one agent is designated as leader and sets the coordination strategy; the other acts as follower
and adapts its implementation plan accordingly. All 39 pairs were successfully evaluated.
Notable: this variant produced the lowest merge conflict rate (17.9%) of all random-50… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/qwen35-9b-leader-follower-coop.diffing-stats-qwen3_1_7B-kansas_abortion-L14-Crosscoder-s2-t100-k100-lr1e-04-x32diffing-stats-SAEdiff_ftb-qwen3_1_7B-kansas_abortion-L14-s1-t200-k100-lr1e-04-x32osdi-attention-08-qwen-qwen3-30b-a3b-instruct-2507-h200-nvlqwen3.5-temporal-blindspot
Temporal Misalignment Under Persona Conditioning
A Blind Spot Dataset for Qwen3.5-4B
Model Tested: Qwen/Qwen3.5-4BAuthor: Areeba Fatima — LUMS BS Computer ScienceTask: Probing temporal grounding failure modes in instruction-tuned LLMs
Motivation
Large language models are trained on static snapshots of the world but deployed
in dynamic contexts where temporal grounding matters. This dataset systematically
probes whether Qwen3.5-4B — a 4B parameter multimodal… See the full description on the dataset page: https://huggingface.co/datasets/areeba-sloth/qwen3.5-temporal-blindspot.diffing-stats-qwen3_1_7B-taboo_wave-L14-Crosscoder-s2-t100-k100-lr1e-04-x32diffing-stats-qwen3_1_7B-comment_cake_bake-L14-Crosscoder-s2-t100-k100-lr1e-04-x32diffing-stats-SAEdiff_ftb-qwen3_1_7B-em_bad_medical_advice-L14-s2-t100-k100-lr1e-04-x2qwen3-atlasQandA_with_Qwen3_Reasoningqwen35-9b-test-impl-split-coop
What this is
Cooperative two-agent coding dataset: 48 task pairs across 15 repos (random-50 subset), generated
with mini_swe_agent on Qwen/Qwen3.5-9B in coop setting using a test-impl-split prompt variant —
one agent is assigned the role of writing tests; the other writes the implementation. The two
patches cover non-overlapping files, which eliminates merge conflicts entirely.
Key finding: This variant achieves a 100% clean merge rate (0 conflicts across all 48 pairs),
but a 0%… See the full description on the dataset page: https://huggingface.co/datasets/CooperBench/qwen35-9b-test-impl-split-coop.diffing-stats-qwen3_1_7B-cake_bake-L14-Crosscoder-s2-t100-k100-lr1e-04-x32diffing-stats-SAEdiff_ftb-qwen3_1_7B-kansas_abortion-L14-k100-x4-lr1e-04-t200diffing-stats-SAEdiff_ftb-qwen3_1_7B-kansas_abortion-L14-s1-t100-k100-lr1e-04-x2diffing-stats-SAEdiff_ftb-qwen3_1_7B-cake_bake-L14-s2-t100-k100-lr1e-04-x2
