datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Unroll-Qwen2.5-7B-Instruct_1754599205_eval_3444_gpqadiamond_skip_attn_idx_2
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599205_eval_3444_gpqadiamond_skip_attn_idx_2
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 38.38% ± 1.09%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
36.36%
72
198
2
37.88%
75
198
3
40.91%
81
198
Unroll-Qwen2.5-7B-Instruct_1754599336_eval_3444_gpqadiamond_skip_attn_idx_5
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599336_eval_3444_gpqadiamond_skip_attn_idx_5
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 27.27% ± 1.72%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
23.23%
46
198
2
28.28%
56
198
3
30.30%
60
198
Unroll-Qwen2.5-7B-Instruct_1754599421_eval_3444_gpqadiamond_skip_attn_idx_7
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599421_eval_3444_gpqadiamond_skip_attn_idx_7
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 33.84% ± 1.95%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
30.30%
60
198
2
32.83%
65
198
3
38.38%
76
198
Unroll-Qwen2.5-7B-Instruct_1754599159_eval_3444_gpqadiamond_skip_attn_idx_1
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599159_eval_3444_gpqadiamond_skip_attn_idx_1
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 16.16% ± 0.41%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
15.66%
31
198
2
15.66%
31
198
3
17.17%
34
198
Unroll-Qwen2.5-7B-Instruct_1754577788_eval_3444_gpqadiamond_prn_attn_idx_0Unroll-Qwen2.5-7B-Instruct_1754599248_eval_3444_gpqadiamond_skip_attn_idx_3
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599248_eval_3444_gpqadiamond_skip_attn_idx_3
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 22.56% ± 0.73%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
21.21%
42
198
2
22.22%
44
198
3
24.24%
48
198
Unroll-Qwen2.5-7B-Instruct_1754599292_eval_3444_gpqadiamond_skip_attn_idx_4
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599292_eval_3444_gpqadiamond_skip_attn_idx_4
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 27.61% ± 1.35%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
26.77%
53
198
2
25.25%
50
198
3
30.81%
61
198
Unroll-Qwen2.5-7B-Instruct_1754599506_eval_3444_gpqadiamond_skip_attn_idx_9
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599506_eval_3444_gpqadiamond_skip_attn_idx_9
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 23.91% ± 0.77%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
22.73%
45
198
2
23.23%
46
198
3
25.76%
51
198
Unroll-Qwen2.5-7B-Instruct_1754599117_eval_3444_gpqadiamond_skip_attn_idx_0
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599117_eval_3444_gpqadiamond_skip_attn_idx_0
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 6.23% ± 0.36%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
7.07%
14
198
2
5.56%
11
198
3
6.06%
12
198
Unroll-Qwen2.5-7B-Instruct_1754592824_eval_759d_aime24_skip_attn_idx_10
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754592824_eval_759d_aime24_skip_attn_idx_10
Precomputed model outputs for evaluation.
Evaluation Results
AIME24
Average Accuracy: 10.00% ± 1.15%
Number of Runs: 10
Run
Accuracy
Questions Solved
Total Questions
1
6.67%
2
30
2
10.00%
3
30
3
16.67%
5
30
4
6.67%
2
30
5
6.67%
2
30
6
6.67%
2
30
7
10.00%
3
30
8
10.00%
3
30
9
16.67%
5
30
10
10.00%
3
30
Unroll-Qwen2.5-7B-Instruct_1754599547_eval_3444_gpqadiamond_skip_attn_idx_10
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599547_eval_3444_gpqadiamond_skip_attn_idx_10
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 27.95% ± 2.15%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
23.23%
46
198
2
28.28%
56
198
3
32.32%
64
198
Qwen3-30B-MagpieLM-SFT-Outputs-v0.1-shard1-llama8b_idx0Unroll-Qwen2.5-7B-Instruct_1754599679_eval_3444_gpqadiamond_skip_attn_idx_11
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599679_eval_3444_gpqadiamond_skip_attn_idx_11
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 29.46% ± 2.98%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
23.23%
46
198
2
29.29%
58
198
3
35.86%
71
198
Unroll-Qwen2.5-7B-Instruct_1754599633_eval_3444_gpqadiamond_skip_attn_idx_12
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599633_eval_3444_gpqadiamond_skip_attn_idx_12
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 37.04% ± 0.36%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
37.88%
75
198
2
36.36%
72
198
3
36.87%
73
198
Unroll-Qwen2.5-7B-Instruct_1754646934_eval_6419_livecodebench_skip_ffn_idx_8_v2
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754646934_eval_6419_livecodebench_skip_ffn_idx_8_v2
Precomputed model outputs for evaluation.
Evaluation Results
LiveCodeBench
Average Accuracy: 20.38% ± 0.49%
Number of Runs: 6
Run
Accuracy
Questions Solved
Total Questions
1
21.33%
109
511
2
20.35%
104
511
3
20.55%
105
511
4
18.59%
95
511
5
21.92%
112
511
6
19.57%
100
511
Unroll-Qwen2.5-7B-Instruct_1754599715_eval_3444_gpqadiamond_skip_attn_idx_14
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599715_eval_3444_gpqadiamond_skip_attn_idx_14
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 31.65% ± 1.10%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
30.30%
60
198
2
30.30%
60
198
3
34.34%
68
198
Unroll-Qwen2.5-7B-Instruct_1754599800_eval_3444_gpqadiamond_skip_attn_idx_16
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599800_eval_3444_gpqadiamond_skip_attn_idx_16
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 31.48% ± 1.45%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
28.79%
57
198
2
30.81%
61
198
3
34.85%
69
198
Unroll-Qwen2.5-7B-Instruct_1754599380_eval_3444_gpqadiamond_skip_attn_idx_6
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599380_eval_3444_gpqadiamond_skip_attn_idx_6
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 40.40% ± 0.48%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
40.40%
80
198
2
39.39%
78
198
3
41.41%
82
198
Unroll-Qwen2.5-7B-Instruct_1754599884_eval_3444_gpqadiamond_skip_attn_idx_18
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599884_eval_3444_gpqadiamond_skip_attn_idx_18
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 31.65% ± 2.84%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
26.77%
53
198
2
29.80%
59
198
3
38.38%
76
198
Unroll-Qwen2.5-7B-Instruct_1754642239_eval_3444_gpqadiamond_skip_ffn_idx_5
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754642239_eval_3444_gpqadiamond_skip_ffn_idx_5
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 28.28% ± 2.51%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
23.23%
46
198
2
27.78%
55
198
3
33.84%
67
198
Unroll-Qwen2.5-7B-Instruct_1754631187_eval_3444_gpqadiamond_skip_ffn_idx_0
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754631187_eval_3444_gpqadiamond_skip_ffn_idx_0
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 30.64% ± 0.27%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
30.30%
60
198
2
31.31%
62
198
3
30.30%
60
198
SmolLM2-135M-10B-tmp-idxUnroll-Qwen2.5-7B-Instruct_1754599675_eval_3444_gpqadiamond_skip_attn_idx_13
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599675_eval_3444_gpqadiamond_skip_attn_idx_13
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 33.33% ± 1.26%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
30.30%
60
198
2
35.35%
70
198
3
34.34%
68
198
Unroll-Qwen2.5-7B-Instruct_1754599757_eval_3444_gpqadiamond_skip_attn_idx_15
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599757_eval_3444_gpqadiamond_skip_attn_idx_15
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 37.37% ± 0.63%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
36.36%
72
198
2
36.87%
73
198
3
38.89%
77
198
Unroll-Qwen2.5-7B-Instruct_1754600010_eval_3444_gpqadiamond_skip_attn_idx_21
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754600010_eval_3444_gpqadiamond_skip_attn_idx_21
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 34.34% ± 2.18%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
30.30%
60
198
2
33.33%
66
198
3
39.39%
78
198
Unroll-Qwen2.5-7B-Instruct_1754600052_eval_3444_gpqadiamond_skip_attn_idx_22
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754600052_eval_3444_gpqadiamond_skip_attn_idx_22
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 29.63% ± 1.75%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
26.77%
53
198
2
28.28%
56
198
3
33.84%
67
198
Unroll-Qwen2.5-7B-Instruct_1754599463_eval_3444_gpqadiamond_skip_attn_idx_8
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599463_eval_3444_gpqadiamond_skip_attn_idx_8
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 31.14% ± 1.31%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
29.80%
59
198
2
29.29%
58
198
3
34.34%
68
198
Unroll-Qwen2.5-7B-Instruct_1754599844_eval_3444_gpqadiamond_skip_attn_idx_17
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754599844_eval_3444_gpqadiamond_skip_attn_idx_17
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 26.94% ± 1.67%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
23.23%
46
198
2
27.27%
54
198
3
30.30%
60
198
Unroll-Qwen2.5-7B-Instruct_1754602525_eval_3444_gpqadiamond_skip_attn_idx_24
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754602525_eval_3444_gpqadiamond_skip_attn_idx_24
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 28.45% ± 1.69%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
25.25%
50
198
2
27.78%
55
198
3
32.32%
64
198
Unroll-Qwen2.5-7B-Instruct_1754602616_eval_3444_gpqadiamond_skip_attn_idx_26
chengfu0118/Unroll-Qwen2.5-7B-Instruct_1754602616_eval_3444_gpqadiamond_skip_attn_idx_26
Precomputed model outputs for evaluation.
Evaluation Results
GPQADiamond
Average Accuracy: 27.78% ± 0.71%
Number of Runs: 3
Run
Accuracy
Questions Solved
Total Questions
1
27.78%
55
198
2
26.26%
52
198
3
29.29%
58
198
