tyson0420/stack_codellama-7b-inst

Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->

Model Details

Evaluating generations... { "humaneval": { "pass@1": 0.32499999999999996, "pass@10": 0.4329268292682927 }, "config": { "prefix": "", "dosample": true, "temperature": 0.2, "topk": 0, "topp": 0.95, "nsamples": 10, "eos": "<|endoftext|>", "seed": 0, "model": "tyson0420/stackcodellama-7b-inst", "modeltype": "causal", "peftmodel": null, "revision": null, "useauthtoken": false, "trustremotecode": false, "tasks": "humaneval", "instructiontokens": null, "batchsize": 10, "maxlengthgeneration": 512, "precision": "fp32", "loadin8bit": false, "loadin4bit": false, "leftpadding": false, "limit": null, "limitstart": 0, "saveeveryktasks": -1, "postprocess": true, "allowcodeexecution": true, "generationonly": false, "loadgenerationspath": null, "loaddatapath": null, "metricoutputpath": "evaluationresults.json", "savegenerations": false, "loadgenerationsintermediatepaths": null, "savegenerationspath": "generations.json", "savereferences": false, "savereferencespath": "references.json", "prompt": "prompt", "maxmemorypergpu": null, "checkreferences": false } }

Model Description

<!-- Provide a longer summary of what this model is. -->

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

• —Developed by: [tyson0420]