kth8/gemma-4-E4B-it-ValleyBench-benchmark

Benchmark of google/gemma-4-E4B-it against kth8/ValleyBench dataset. Model's answer is considered correct if it is within 0.01 of ground answer. Accuracy: 80.3% with Python tool. Metric Value Correct 4014 Incorrect 958 Errors 28 Total samples 5000 Python tool calls 4843 Total completion tokens 4,595,312 Raw stats: { "accuracy": 0.803, "correct": 4014, "incorrect": 958, "error": 28, "total": 5000, "python_tool_calls": 4843, "completion_tokens": 4595312 }