datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
FaroeseSTS
FaroeseSTS
An MTEB dataset
Massive Text Embedding Benchmark
Semantic Text Similarity (STS) corpus for Faroese.
Task category
t2t
Domains
News, Web, Written
Reference
https://aclanthology.org/2023.nodalida-1.74.pdf
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["FaroeseSTS"])
evaluator = mteb.MTEB(task)
model = mteb.get_model(YOUR_MODEL)
evaluator.run(model)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/FaroeseSTS.faroese-stsThis is a Semantic Text Similarity (STS) corpus for Faroese, Fo-STS, it was created by translating the English STS dataset.
If you find this dataset useful, please cite
@inproceedings{snaebjarnarson-etal-2023-transfer,
title = "{T}ransfer to a Low-Resource Language via Close Relatives: The Case Study on Faroese",
author = "Snæbjarnarson, Vésteinn and
Simonsen, Annika and
Glavaš, Goran and
Vulić, Ivan",
booktitle = "Proceedings of the 24th Nordic Conference on… See the full description on the dataset page: https://huggingface.co/datasets/vesteinn/faroese-sts.faroese-dynaword
🧨 Faroese Dynaword
Version
0.0.7 (Changelog)
Language
Faroese (fo, fao)
License
Openly Licensed, See the respective dataset
Models
Currently there are no models trained on this dataset
Contact
If you have question about this project please create an issue here
Dataset Description
Number of samples: 405.81K
Number of tokens (Llama 3): 45.40M
Average document length in tokens (min, max): 111.87 (2, 109.50K)
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/danish-foundation-models/faroese-dynaword.scandinavian_faroesefaroese-dyna-instruct
🧨 Faroese dyna-instruct
Version
0.1.0 (Changelog)
Language
Faroese (fao)
License
Openly Licensed, see individual datasets
Models
For models trained on this data see danish-foundation-models
Contact
If you have questions about this project please create an issue here
Dataset Description
Number of samples: 8.61K
Number of tokens (Llama 3): 2.64M
Average conversation length in tokens (min, max): 306.67 (98, 1.24K)
Average number of… See the full description on the dataset page: https://huggingface.co/datasets/danish-foundation-models/faroese-dyna-instruct.faroese-blimp-single-errorfaroese-flan
Faroese FLAN
Faroese instruction-following data, built by pairing licensed or public-domain, human-written Faroese
texts with deterministic instruction templates. The sibling of the Icelandic collection, with the same
row schema and the same release checks.
Status
13 sources · 31 tasks · 1,000,543 rows · 34.0M response characters.
Source
Register
Licence
Rows
Response chars
Share
logir
consolidated law
public-domain-fo-p9
29,178
14,798,010
43.6%… See the full description on the dataset page: https://huggingface.co/datasets/Frejams/faroese-flan.closest_faroeseFaroese-Handwritten-OCR
Faroese Handwritten OCR
Public draft, version 0.1: an alignment pilot with 16 line-image/text pairs from one
historical Faroese manuscript page. No rows are verified benchmark ground truth.
The page is image 3 of D IV – Ániasar táttur, held by Landsbókasavnið
(National Library of the Faroe Islands) and digitized on HandRit. The manuscript
is associated with the scribe Jóhan Hendrik Schrøter (1842–1911). Proposed
reference text is aligned from Eivind Weyhe's scholarly edition of… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/Faroese-Handwritten-OCR.Faroese-Instructfaroese-klaksvik-fo
Klaksvíkar kommuna (klaksvik_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Council and committee material, budgets, regulations, downloadable documents and
municipal web pages.
Source: Klaksvíkar kommuna
Size
Measure
Value
Documents
614
Characters
7,381,910
Tokens
3,326,520
Possible official documents
13
Tokens in possible official documents
6,860
File type
Documents… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-klaksvik-fo.faroese-fuglafjordur-fo
Fuglafjarðar kommuna (fuglafjordur_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Council and news records, harbour rules, applications, plans, documents and municipal
pages.
Source: Fuglafjarðar kommuna
Size
Measure
Value
Documents
1,735
Characters
5,482,158
Tokens
2,414,881
Possible official documents
197
Tokens in possible official documents
119,651
File type
Documents… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-fuglafjordur-fo.faroese-irf-fo
IRF (irf_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Waste rules, environmental information, annual reports, guides, HTML pages and PDFs.
Source: IRF
Size
Measure
Value
Documents
1,595
Characters
3,671,911
Tokens
1,639,348
Possible official documents
17
Tokens in possible official documents
20,047
File type
Documents
HTML
1,440
PDF
155
DOCX
0
CSV
0
plain… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-irf-fo.faroese-gjaldstovan-fo
Gjaldstovan (gjaldstovan_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
National accounts, accounting instructions, forms, reports, HTML pages, PDFs and DOCX
files.
Source: Gjaldstovan
Size
Measure
Value
Documents
747
Characters
22,185,609
Tokens
9,335,908
Possible official documents
10
Tokens in possible official documents
173,767
File type
Documents
HTML
361
PDF… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-gjaldstovan-fo.faroese-landsverk-fo
Landsverk (landsverk_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Building regulations, technical guidance, infrastructure reports, traffic statistics,
HTML pages and PDFs.
Source: Landsverk
Size
Measure
Value
Documents
2,265
Characters
12,503,618
Tokens
5,469,944
Possible official documents
55
Tokens in possible official documents
731,566
File type
Documents
HTML
2… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-landsverk-fo.faroese-parallel-biblefaroese-studni-fo
Studni (studni_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Student-support rules, guidance, forms, HTML pages and downloadable documents.
Source: Studni
Size
Measure
Value
Documents
161
Characters
820,888
Tokens
336,130
Possible official documents
12
Tokens in possible official documents
95,941
File type
Documents
HTML
118
PDF
43
DOCX
0
CSV
0
plain text
0… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-studni-fo.sosialurin-faroese-nerThe corpus that has been created consists of ca. 100.000 words of text from the [Faroese] newspaper Sosialurin. Each word is tagged with named entity informationfaroese-taks-fo
TAKS (taks_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Tax and customs laws, circulars, guidance, forms, HTML pages, PDFs, DOCX/CSV files and
linked Kærustovnur decisions.
Source: TAKS
Size
Measure
Value
Documents
1,178
Characters
13,463,572
Tokens
5,127,975
Possible official documents
205
Tokens in possible official documents
765,561
File type
Documents
HTML
852… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-taks-fo.faroese-politi-fo
Føroya Politi (politi_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Police guidance, notices, public information, statistics, news and downloadable
documents.
Source: Føroya Politi
Size
Measure
Value
Documents
363
Characters
1,153,967
Tokens
429,944
Possible official documents
10
Tokens in possible official documents
5,649
File type
Documents
HTML
336
PDF
24
DOCX… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-politi-fo.faroese-bustadir-fo
Bústaðir (bustadir_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Public-housing laws, regulations, annual reports, guidance, service pages and PDFs.
Source: Bústaðir
Size
Measure
Value
Documents
120
Characters
862,002
Tokens
394,328
Possible official documents
7
Tokens in possible official documents
25,042
File type
Documents
HTML
64
PDF
56
DOCX
0
CSV
0
plain… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-bustadir-fo.faroese-vangin-fo
Vangin (vangin_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Instructions for national digital services, terms, forms, downloadable documents and
public service pages.
Source: Vangin
Size
Measure
Value
Documents
146
Characters
601,147
Tokens
232,172
Possible official documents
0
Tokens in possible official documents
0
File type
Documents
HTML
142
PDF
4
DOCX
0… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-vangin-fo.faroese-heilsutrygd-fo
Heilsutrygd (heilsutrygd_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Health-insurance rules, complaint guidance, forms, service pages and first-party PDFs.
Source: Heilsutrygd
Size
Measure
Value
Documents
104
Characters
573,714
Tokens
237,399
Possible official documents
3
Tokens in possible official documents
3,011
File type
Documents
HTML
62
PDF
42
DOCX
0… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-heilsutrygd-fo.faroese-ssl-fo
Strandfaraskip Landsins (ssl_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Transport law, ferry and bus statistics, reports, timetables, guidance, HTML pages and
documents.
Source: Strandfaraskip Landsins
Size
Measure
Value
Documents
1,015
Characters
1,518,963
Tokens
650,125
Possible official documents
8
Tokens in possible official documents
4,782
File type
Documents… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-ssl-fo.faroese-sev-fo
SEV (sev_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Energy rules, tariffs, annual accounts, reports, studies, HTML pages and first-party
documents.
Source: SEV
Size
Measure
Value
Documents
1,861
Characters
27,193,745
Tokens
10,875,867
Possible official documents
76
Tokens in possible official documents
1,151,101
File type
Documents
HTML
1,625
PDF
233
DOCX
3… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-sev-fo.faroese-apotek-fo
Apoteksverkið (apotek_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Medicines law, public guidance, statistics, forms, service pages and PDFs.
Source: Apoteksverkið
Size
Measure
Value
Documents
427
Characters
1,298,306
Tokens
555,241
Possible official documents
4
Tokens in possible official documents
2,494
File type
Documents
HTML
374
PDF
53
DOCX
0
CSV
0… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-apotek-fo.faroese-eidi-fo
Eiðis kommuna (eidi_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Meeting records, budgets, annual accounts, WordPress pages and downloadable municipal
documents.
Source: Eiðis kommuna
Size
Measure
Value
Documents
1,884
Characters
9,567,289
Tokens
4,275,428
Possible official documents
65
Tokens in possible official documents
60,023
File type
Documents
HTML
1,724… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-eidi-fo.faroese-sjovar-fo
Sjóvar kommuna (sjovar_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Budget and account archives, governance rules, meeting records, news and general
municipal content.
Source: Sjóvar kommuna
Size
Measure
Value
Documents
378
Characters
793,218
Tokens
362,981
Possible official documents
5
Tokens in possible official documents
11,790
File type
Documents
HTML
378
PDF… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-sjovar-fo.faroese-av-fo
Almannaverkið (av_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Social-service benefits, procedures, public information and service pages.
Source: Almannaverkið
Size
Measure
Value
Documents
379
Characters
2,035,642
Tokens
1,001,768
Possible official documents
9
Tokens in possible official documents
22,797
File type
Documents
HTML
379
PDF
0
DOCX
0
CSV
0
plain… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-av-fo.faroese-dat-fo
Dátueftirlitið (dat_fo)
Status: Standalone website collection. It is not part of Faroese Dynaword.
About this data
Data-protection decisions, regulatory guidance, annual reports, news and authority
pages.
Source: Dátueftirlitið
Size
Measure
Value
Documents
214
Characters
1,106,336
Tokens
482,127
Possible official documents
46
Tokens in possible official documents
88,926
File type
Documents
HTML
214
PDF
0
DOCX
0… See the full description on the dataset page: https://huggingface.co/datasets/V4ldeLund/faroese-dat-fo.
