CoolFace
Datasetpublic

Yobitel/mistralai-mistral-7b-instruct-v0-3__code-generation-humaneval-mini__019e3b4630cb

mistralai/Mistral-7B-Instruct-v0.3 on code.generation.humaneval-mini (NVIDIA H100 80GB HBM3) Back to leaderboard Headline metrics Metric Value Unit N Samples 5 N Ok 5 Ok Rate 1 Pass At 1 0.8 Pass At 1 P05 0.2 Pass At 1 P50 1 Pass At 1 P95 1 Timeout Rate 0 TTFT P50 14.9549 ms Total P50 Ms 1243.2378 Tokens Out Total 824 Run configuration Model: mistralai/Mistral-7B-Instruct-v0.3 @ unknown00 Engine: vllm… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/mistralai-mistral-7b-instruct-v0-3__code-generation-humaneval-mini__019e3b4630cb.

sourceHugging Facecc-by-4.0updated 4mo agoView on Hugging Face
0likes6downloads
Dataset Card

mistralai/Mistral-7B-Instruct-v0.3 on code.generation.humaneval-mini (NVIDIA H100 80GB HBM3)

Back to leaderboard

Headline metrics

MetricValueUnit
N Samples5
N Ok5
Ok Rate1
Pass At 10.8
Pass At 1 P050.2
Pass At 1 P501
Pass At 1 P951
Timeout Rate0
TTFT P5014.9549ms
Total P50 Ms1243.2378
Tokens Out Total824

Run configuration

  • —Model: mistralai/Mistral-7B-Instruct-v0.3 @ unknown00
  • —Engine: vllm vunknown
  • —Quantization: fp16
  • —Hardware: NVIDIA H100 80GB HBM3
  • —Driver: 580.126.09
  • —CUDA: 13.0
  • —Run date: 2026-05-18T13:28:36.299547+00:00
  • —Seed: 0

Verification

This result is Sigstore-signed and Rekor-logged. Verify:

bash
pip install inferencebench
bench verify hf://datasets/Yobitel/mistralai-mistral-7b-instruct-v0-3__code-generation-humaneval-mini__019e3b4630cb/envelope.json

Rekor entry: log index -1

Methodology

See the suite methodology page.

Citation

bibtex
@misc{inferencebench_019e3b4630cb,
  title = { mistralai/Mistral-7B-Instruct-v0.3 on code.generation.humaneval-mini },
  author = { {InferenceBench community} },
  year = { 2026 },
  url = { https://huggingface.co/datasets/Yobitel/mistralai-mistral-7b-instruct-v0-3__code-generation-humaneval-mini__019e3b4630cb },
}

Published via [InferenceBench](https://github.com/yobitelcomm/bench) — vendor-neutral AI benchmarks.