Apppublic

bigcode/bigcode-models-leaderboard

sourceHugging Faceupdated 2y agoView on Hugging Face

1.5klikes

rootcommunity_resultsbigcode_octocoder_loubnabnlmetrics_octocodermetrics_humaneval_octocoder.json

metrics_humaneval_octocoder.json11 linesDownload Raw Back to metrics_octocoder

1{2  "humaneval": {3    "pass@1": 0.355609756097561,4    "pass@10": 0.51805291508895835  },6  "config": {7    "model": "bigcode/octocoder",8    "temperature": 0.2,9    "n_samples": 5010  }11}