T3Q-LLM/T3Q-LLM-TE-NLI-Lora32_32-v1.0

Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->

Model Details

Model Description

<!-- Provide a longer summary of what this model is. -->

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

• —Developed by: [More Information Needed]
• —Funded by [optional]: [More Information Needed]
• —Shared by [optional]: [More Information Needed]
• —Model type: [More Information Needed]
• —Language(s) (NLP): [More Information Needed]
• —License: [More Information Needed]
• —Finetuned from model [optional]: [More Information Needed]

Model Sources [optional]

<!-- Provide the basic links for the model. -->

• —Repository: [More Information Needed]
• —Paper [optional]: [More Information Needed]
• —Demo [optional]: [More Information Needed]

hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM-TE-NLI-Lora3232-v1.0,useaccelerate=true,trustremotecode=true), limit: None, providedescription: False, numfewshot: 0, batchsize: 8 | Task |Version| Metric |Value | |Stderr| |----------------|------:|--------|-----:|---|-----:| |kobestboolq | 0|acc |0.9573|± |0.0054| | | |macrof1|0.9573|± |0.0054| |kobestcopa | 0|acc |0.7820|± |0.0131| | | |macrof1|0.7817|± |0.0131| |kobesthellaswag| 0|acc |0.5200|± |0.0224| | | |accnorm|0.5380|± |0.0223| | | |macrof1|0.5177|± |0.0224| |kobestsentineg | 0|acc |0.8942|± |0.0155| | | |macrof1|0.8939|± |0.0155|