datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
icelandic-common-crawl-corpus-IC3This is the Icelandic Common Crawl Corpus (IC3).
icelandic_qa_scandevalA question answering dataset for evaluating LLMs' ability to answer Icelandic questions on Icelandic culture and history.
The dataset contains 2,000 pairs of questions and answers in Icelandic on the topic of Icelandic culture and history. All pairs were automatically created using GPT-4-turbo and then manually reviewed and augmented. 1,900 pairs were created from Icelandic Wikipedia articles and 100 pairs were created from Icelandic online news, the RÚV subcorpus of the Icelandic Gigaword… See the full description on the dataset page: https://huggingface.co/datasets/mideind/icelandic_qa_scandeval.icelandic_wiki_qaThe dataset is intended as test data and can be used freely as such. If any other use is intended, see OpenAI's terms and conditions on using its output. The dataset contains questions and answers created by GPT-4-turbo, which have been manually reviewed and corrected.
icelandic-arc-challenge
Dataset Card for Icelandic ARC-Challenge
This dataset is an Icelandic machine-translated version of the original English ARC-Challenge.
icelandic-winogrande
Icelandic WinoGrande dataset
This is the Icelandic WinoGrande dataset described in the IceBERT paper https://aclanthology.org/2022.lrec-1.464.pdf .
Translation and localization
The records were manually translated and localized (skipped if localization was not possible) from English.
For the examples which were singlets instead of sentence pairs we added a corresponding sentence.
The "translations per se" are not exact since accurately preserving the original semantics is… See the full description on the dataset page: https://huggingface.co/datasets/mideind/icelandic-winogrande.icelandic-parallel-abstracts-corpus-IPACSee https://arxiv.org/abs/2108.05289
icelandic-english-translationicelandic-inflection-mediumicelandic-inflection-easyicelandic-inflection-hardicelandic-sentences-gecenglish-icelandic-translationicelandic-inflection-all-flat