CoolFace
Modelpublic

deepset/gbert-large-sts

sourceHugging Facemitupdated 2y agoView on Hugging Face
8likes64downloads
Model Card

Overview

Language model: gbert-large-sts

Language: German Training data: German STS benchmark train and dev set Eval data: German STS benchmark test set Infrastructure: 1x V100 GPU Published: August 12th, 2021

Details

  • —We trained a gbert-large model on the task of estimating semantic similarity of German-language text pairs. The dataset is a machine-translated version of the STS benchmark, which is available here.

Hyperparameters

batch_size = 16
n_epochs = 4
warmup_ratio = 0.1
learning_rate = 2e-5
lr_schedule = LinearWarmup

Performance

Stay tuned... and watch out for new papers on arxiv.org ;)

Authors

  • —Julian Risch: julian.risch [at] deepset.ai
  • —Timo Möller: timo.moeller [at] deepset.ai
  • —Julian Gutsch: julian.gutsch [at] deepset.ai
  • —Malte Pietsch: malte.pietsch [at] deepset.ai

About us

<div class="grid lg:grid-cols-2 gap-x-4 gap-y-3"> <div class="w-full h-40 object-cover mb-2 rounded-lg flex items-center justify-center"> <img alt="" src="https://raw.githubusercontent.com/deepset-ai/.github/main/deepset-logo-colored.png" class="w-40"/> </div> <div class="w-full h-40 object-cover mb-2 rounded-lg flex items-center justify-center"> <img alt="" src="https://raw.githubusercontent.com/deepset-ai/.github/main/haystack-logo-colored.png" class="w-40"/> </div> </div>

deepset is the company behind the production-ready open-source AI framework Haystack.

Some of our other work:

Get in touch and join the Haystack community

<p>For more info on Haystack, visit our <strong><a href="https://github.com/deepset-ai/haystack">GitHub</a></strong> repo and <strong><a href="https://docs.haystack.deepset.ai">Documentation</a></strong>.

We also have a <strong><a class="h-7" href="https://haystack.deepset.ai/community">Discord community open to everyone!</a></strong></p>

Twitter | LinkedIn | Discord | GitHub Discussions | Website | YouTube

By the way: we're hiring!