Modelpublic

JohanHeinsen/Old_News_Segmentation_SBERT_V0

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes67downloads

Model Card

SentenceTransformer based on CALDISS-AAU/DA-BERTOldNews_V1

This is a sentence-transformers model finetuned from CALDISS-AAU/DA-BERT_Old_News_V1. It is an early version of a model meant to assist in segmenting ENO.

Model Details

Model Description

—Model Type: Sentence Transformer
—Base model: CALDISS-AAU/DA-BERT_Old_News_V1
—Maximum Sequence Length: 512 tokens
—Output Dimensionality: 768 dimensions

Training Details

Training Dataset

Unnamed Dataset

—Size: 27,869 training samples
—Columns: <code>sentence0</code>, <code>sentence1</code>, and <code>label</code>
—Approximate statistics based on the first 1000 samples: | | sentence0 | sentence1 | label | |:--------|:-----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:---------------------------------------------------------------| | type | string | string | float | | details | <ul><li>min: 4 tokens</li><li>mean: 41.42 tokens</li><li>max: 401 tokens</li></ul> | <ul><li>min: 4 tokens</li><li>mean: 41.21 tokens</li><li>max: 286 tokens</li></ul> | <ul><li>min: 0.0</li><li>mean: 0.46</li><li>max: 1.0</li></ul> |
—Samples: | sentence0 | sentence1 | label | |:-------------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------| | <code>6) Paa Hjørnet af Integaden og lilie Kongensgade ligge to store Trækasser, sog afspærre Passagen, og truer dem, der i Mørke kunde løbe paa dem.</code> | <code>7) Paa Østergade er der intet Bræt over den Rendesteen der kommer ud fra Per Madsens Gang og med en dyb Kisterende overskærer Fortoget.</code> | <code>1.0</code> | | <code>Ganske Fattige undervises for intet, og Seminaristerne bibringer han sin Methode.</code> | <code>Ved et af ham selv opfundet Tegnsprog giver han sin Undervisning Indgang.</code> | <code>1.0</code> |