CoolFace
Modelpublic

ciCic/dutch-english-paraphrase-multilingual-mpnet-base-v2

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes76downloads
Model Card

pipeline_tag: sentence-similarity language: nl license: apache-2.0 tags:

  • —passage-retrieval
  • —sentence-similarity
  • —pruned libraryname: sentence-transformers basemodel: sentence-transformers/paraphrase-multilingual-mpnet-base-v2 basemodelrelation: quantized ---

🇳🇱 dutch-english-paraphrase-multilingual-mpnet-base-v2

This model is a 56.1% smaller version of sentence-transformers/paraphrase-multilingual-mpnet-base-v2 for the Dutch language, created using the mtem-pruner space.

This pruned model should perform similarly to the original model for Dutch language tasks with a much smaller memory footprint. However, it may not perform well for other languages present in the original multilingual model as tokens not commonly used in Dutch were removed from the original multilingual model's vocabulary.

Usage

You can use this model with the Transformers library:

python
from transformers import AutoModel, AutoTokenizer

model_name = "ciCic/dutch-english-paraphrase-multilingual-mpnet-base-v2"
model = AutoModel.from_pretrained(model_name, trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True, use_fast=True)

Or with the sentence-transformers library:

python
from sentence_transformers import SentenceTransformer

model = SentenceTransformer("ciCic/dutch-english-paraphrase-multilingual-mpnet-base-v2")

Credits: cc @antoinelouis