CoolFace
Modelpublic

SOTAagi2030/AssistantModel-Best

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face
0likes9downloads
Model Card

AssistantModel

<!-- markdownlint-disable first-line-h1 --> <!-- markdownlint-disable html --> <!-- markdownlint-disable no-duplicate-header -->

<div align="center"> <img src="figures/fig1.png" width="60%" alt="AssistantModel" /> </div> <hr>

<div align="center" style="line-height: 1;"> <a href="LICENSE" style="margin: 2px;"> <img alt="License" src="figures/fig2.png" style="display: inline-block; vertical-align: middle;"/> </a> </div>

1. Introduction

AssistantModel is designed for interactive assistant applications. This checkpoint is selected based on the combined performance of knowledge retrieval and instruction following benchmarks, making it ideal for AI assistant deployment.

<p align="center"> <img width="80%" src="figures/fig3.png"> </p>

2. Evaluation Results

Comprehensive Benchmark Results

<div align="center">

BenchmarkAssistant-v1Assistant-v2AssistantModel
Core Reasoning TasksMath Reasoning0.5100.5350.550
Logical Reasoning0.7890.8010.819
Common Sense0.7160.7020.736
Language UnderstandingReading Comprehension0.6710.6850.700
Question Answering0.5820.5990.607
Text Classification0.8030.8110.828
Sentiment Analysis0.7770.7810.792
Generation TasksCode Generation0.6150.6310.650
Creative Writing0.5880.5790.636
Dialogue Generation0.6210.6350.644
Summarization0.7450.7550.767
Specialized CapabilitiesTranslation0.7820.7990.804
Knowledge Retrieval0.6510.6680.676
Instruction Following0.7330.7490.758
Safety Evaluation0.7180.7010.803

</div>

3. License

Apache-2.0 License

4. Contact

Open an issue on GitHub.