Datasetpublic

kth8/gemma-4-E4B-it-ValleyBench-benchmark

Benchmark of google/gemma-4-E4B-it against kth8/ValleyBench dataset. Model's answer is considered correct if it is within 0.01 of ground answer. Accuracy: 80.3% with Python tool. Metric Value Correct 4014 Incorrect 958 Errors 28 Total samples 5000 Python tool calls 4843 Total completion tokens 4,595,312 Raw stats: { "accuracy": 0.803, "correct": 4014, "incorrect": 958, "error": 28, "total": 5000, "python_tool_calls": 4843, "completion_tokens": 4595312 }

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face

0likes9downloads

Dataset Card

license: apache-2.0 language:

—en base_model: google/gemma-4-E4B-it datasets:
—kth8/ValleyBench --- Benchmark of google/gemma-4-E4B-it against kth8/ValleyBench dataset. Model's answer is considered correct if it is within 0.01 of ground answer.

Accuracy: 80.3% with Python tool. | Metric | Value | |----------------------|---------------| | Correct | 4014 | | Incorrect | 958 | | Errors | 28 | | Total samples | 5000 | | Python tool calls| 4843 | | Total completion tokens | 4,595,312 |

Raw stats:

json

{
  "accuracy": 0.803,
  "correct": 4014,
  "incorrect": 958,
  "error": 28,
  "total": 5000,
  "python_tool_calls": 4843,
  "completion_tokens": 4595312
}