CoolFace
Modelpublic

SeanLee97/angle-roberta-wwm-base-zhnli-v1

sourceHugging Facemitupdated 2y agoView on Hugging Face
3likes31downloads
Model Card

AnglE📐: Angle-optimized Text Embeddings

It is Angle 📐, not Angel 👼.

🔥 A New SOTA Model for Semantic Textual Similarity!

Github: https://github.com/SeanLee97/AnglE

<a href="https://arxiv.org/abs/2309.12871"> <img src="https://img.shields.io/badge/Arxiv-2306.06843-yellow.svg?style=flat-square" alt="https://arxiv.org/abs/2309.12871" /> </a>

![PWC](https://paperswithcode.com/sota/semantic-textual-similarity-on-sick-r-1?p=angle-optimized-text-embeddings) ![PWC](https://paperswithcode.com/sota/semantic-textual-similarity-on-sts16?p=angle-optimized-text-embeddings) ![PWC](https://paperswithcode.com/sota/semantic-textual-similarity-on-sts15?p=angle-optimized-text-embeddings) ![PWC](https://paperswithcode.com/sota/semantic-textual-similarity-on-sts14?p=angle-optimized-text-embeddings) ![PWC](https://paperswithcode.com/sota/semantic-textual-similarity-on-sts13?p=angle-optimized-text-embeddings) ![PWC](https://paperswithcode.com/sota/semantic-textual-similarity-on-sts12?p=angle-optimized-text-embeddings) ![PWC](https://paperswithcode.com/sota/semantic-textual-similarity-on-sts-benchmark?p=angle-optimized-text-embeddings)

STS Results

ModelATECBQLCQMCPAWSXSTS-BSOHU-ddSOHU-dcAvg.
^shibing624/text2vec-bge-large-chinese38.4161.3471.7235.1576.4471.8163.1559.72
^shibing624/text2vec-base-chinese-paraphrase44.8963.5874.2440.9078.9376.7063.3063.08
SeanLee97/angle-roberta-wwm-base-zhnli-v149.4972.4778.3359.1377.1472.3660.5367.06
SeanLee97/angle-llama-7b-zhnli-v150.4471.9578.9056.5781.1168.1152.0265.59

^ denotes baselines, their results are retrieved from: https://github.com/shibing624/text2vec

Usage

python
from angle_emb import AnglE

angle = AnglE.from_pretrained('SeanLee97/angle-roberta-wwm-base-zhnli-v1', pooling_strategy='cls').cuda()
vec = angle.encode('你好世界', to_numpy=True)
print(vec)
vecs = angle.encode(['你好世界1', '你好世界2'], to_numpy=True)
print(vecs)

Citation

You are welcome to use our code and pre-trained models. If you use our code and pre-trained models, please support us by citing our work as follows:

bibtex
@article{li2023angle,
  title={AnglE-Optimized Text Embeddings},
  author={Li, Xianming and Li, Jing},
  journal={arXiv preprint arXiv:2309.12871},
  year={2023}
}