T3Q-LLM/T3Q-LLM-TE-NLI-Lora16-v1.0

Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->

Model Details

Model Description

<!-- Provide a longer summary of what this model is. -->

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

• —Developed by: [More Information Needed]
• —Funded by [optional]: [More Information Needed]
• —Shared by [optional]: [More Information Needed]
• —Model type: [More Information Needed]
• —Language(s) (NLP): [More Information Needed]
• —License: [More Information Needed]
• —Finetuned from model [optional]: [More Information Needed]

hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM-TE-NLI-Lora16-v1.0,useaccelerate=true,trustremotecode=true), limit: None, providedescription: False, numfewshot: 0, batchsize: 8 | Task |Version| Metric |Value | |Stderr| |----------------|------:|--------|-----:|---|-----:| |kobestboolq | 0|acc |0.9573|± |0.0054| | | |macrof1|0.9573|± |0.0054| |kobestcopa | 0|acc |0.7880|± |0.0129| | | |macrof1|0.7877|± |0.0129| |kobesthellaswag| 0|acc |0.5220|± |0.0224| | | |accnorm|0.5440|± |0.0223| | | |macrof1|0.5189|± |0.0224| |kobestsentineg | 0|acc |0.8917|± |0.0156| | | |macro_f1|0.8912|± |0.0157|