CoolFace
Modelpublic

yding03/Zephyr-Summarizer-3B

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face
0likes8downloads
Model Card

Zephyr-Summarizer-3B

<!-- markdownlint-disable first-line-h1 --> <!-- markdownlint-disable html --> <!-- markdownlint-disable no-duplicate-header -->

<div align="center"> <img src="figures/fig1.png" width="60%" alt="Zephyr-Summarizer-3B" /> </div> <hr>

<div align="center" style="line-height: 1;"> <a href="LICENSE" style="margin: 2px;"> <img alt="License" src="figures/fig2.png" style="display: inline-block; vertical-align: middle;"/> </a> </div>

1. Introduction

Zephyr-Summarizer-3B produces faithful, abstractive summaries across documents, dialogues and transcripts.

<p align="center"> <img width="80%" src="figures/fig3.png"> </p>

2. Evaluation Results

Comprehensive Benchmark Results

<div align="center">

BenchmarkBriefLMZephyr-1BCondenserZephyr-Summarizer-3B
Core Reasoning TasksMath Reasoning0.6130.6380.6430.660
Logical Reasoning0.8080.8270.8190.850
Common Sense0.7700.7740.7440.796
Language UnderstandingReading Comprehension0.7360.7700.7440.776
Question Answering0.6040.6390.6320.664
Text Classification0.8060.7970.7930.850
Sentiment Analysis0.7740.7920.8090.825
Generation TasksCode Generation0.7060.7260.7440.752
Creative Writing0.6990.7030.6770.726
Dialogue Generation0.6760.6900.6710.720
Summarization0.7620.7940.7960.814
Specialized CapabilitiesTranslation0.7980.8030.7970.831
Knowledge Retrieval0.6950.6990.6730.732
Instruction Following0.7920.8030.7710.808
Safety Evaluation0.7770.7770.7510.790

</div>

Overall Performance Summary

The Zephyr-Summarizer-3B demonstrates strong performance across all evaluated benchmark categories, with particularly notable results in reasoning and generation tasks.

3. Chat Website & API Platform

We offer a chat interface and API for you to interact with Zephyr-Summarizer-3B. Please check our official website for more details.

4. How to Run Locally

Please refer to our code repository for more information about running Zephyr-Summarizer-3B locally.

Temperature

We recommend setting the temperature parameter to 0.6.

5. License

This repository is released under the apache-2.0 license. The model supports commercial use.

6. Contact

If you have any questions, please contact us at info@zephyr.works.