Datasetpublic

kth8/Qwen3.5-27B-AWQ-4bit-GPQA-Diamond-benchmark

Benchmark of cyankiwi/Qwen3.5-27B-AWQ-4bit against fingertap/GPQA-Diamond dataset. Accuracy: 76.3% with Python tool. Metric Value Correct 151 Incorrect 46 Errors 1 Total samples 198 Python tool calls 225 Total completion tokens 659,879 Raw stats: { "accuracy": 0.763, "correct": 151, "incorrect": 46, "error": 1, "total": 198, "python_tool_calls": 225, "completion_tokens": 659879 }

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face

0likes62downloads

Dataset Card

license: apache-2.0 language:

—en base_model: cyankiwi/Qwen3.5-27B-AWQ-4bit datasets:
—fingertap/GPQA-Diamond --- Benchmark of cyankiwi/Qwen3.5-27B-AWQ-4bit against fingertap/GPQA-Diamond dataset.

Accuracy: 76.3% with Python tool. | Metric | Value | |----------------------|---------------| | Correct | 151 | | Incorrect | 46 | | Errors | 1 | | Total samples | 198 | | Python tool calls| 225 | | Total completion tokens | 659,879 |

Raw stats:

json

{
  "accuracy": 0.763,
  "correct": 151,
  "incorrect": 46,
  "error": 1,
  "total": 198,
  "python_tool_calls": 225,
  "completion_tokens": 659879
}