datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
welsh-textsThe National Library of Wales and The Welsh Government have authorized the hosting, distribution, and use of this dataset for public use, including research, scholarship, and machine learning.
License: CC-BY-SA
This dataset contains a variety of printed / handwritten material from Welsh sources, mostly in the Welsh language:
Drych y Prif Oesoedd by Theophilus Evans - a book on the early history of Wales (published 1716)
Enwogion Cymreig by Thomas Morgan - a book cataloging prominent figures… See the full description on the dataset page: https://huggingface.co/datasets/openai/welsh-texts.arc_welshwelsh-cefrtruthfulqa_welshwelsh-translation-instructionThis is a set of Alpaca formatted Welsh-English translation instructions, obtained from the Welsh Government website.
welsh-speech-datasetwelsh-government-pairswelsh_sa
Sentiment Analysis Data for the Welsh Language
Dataset Description:
This dataset contains a sentiment analysis dataset from Espinosa et al. (2021).
Data Structure:
The data was used for the project on improving word embeddings with graph knowledge for Low Resource Languages.
Citation:
@article{espinosa2021english,
title={English--Welsh cross-lingual embeddings},
author={Espinosa-Anke, Luis and Palmer, Geraint and Corcoran, Padraig and Filimonov, Maxim and Spasi{\'c}, Irena and… See the full description on the dataset page: https://huggingface.co/datasets/DGurgurov/welsh_sa.eurfa-welsh-dictionary
Context:
Welsh is a member of the Brittonic branch of the Celtic languages.
It is spoken natively in Wales, by some in England, and in Y Wladfa (the Welsh colony in Chubut Province, Argentina). Historically, it has also been known in English as ‘Cambrian’, ‘Cambric’ and ‘Cymric’.
The current number of Welsh speakers in Wales is over 562,000.
License:
The attached Welsh dictionary data is released under the GPL/AGPL.
Copyright Kevin Donnelly 2006-2013.… See the full description on the dataset page: https://huggingface.co/datasets/Jendersen/eurfa-welsh-dictionary.welsh-speech-landmarks
Welsh Speech Dataset - Facial Landmarks
68-point facial landmarks (ibug68 template) from the Welsh Speech Dataset.
Contents
Facial landmarks for every frame
68 3D points per frame (x, y, z coordinates)
Format: Parquet
Manual annotation using ibug68 template
Format
The landmarks.parquet file contains:
Column
Description
speaker_id
Speaker identifier (1-33)
phrase_id
Phrase identifier (1-10)
frame_id
Frame identifier (e.g., "001", "002")… See the full description on the dataset page: https://huggingface.co/datasets/arvinsingh/welsh-speech-landmarks.welsh-speech-3d-meshes
Welsh Speech Dataset - 3D Facial Meshes
3D facial reconstructions from the Welsh Speech Dataset.
Contents
3D meshes (.obj files) - One per frame
Texture maps (.png files) - Fused left-right stereo images from 3DMD
Captured using 3DMD 6-camera system
~330 zip files (one per speaker-phrase sequence)
File Structure
Files are organized as zip archives in the meshes/ directory, one zip per speaker-phrase sequence:
meshes/
├── speaker_01_phrase_01.zip
├──… See the full description on the dataset page: https://huggingface.co/datasets/arvinsingh/welsh-speech-3d-meshes.alpaca_welsh_tacoThis repository contains the dataset used for the TaCo paper.
The dataset follows the style outlined in the TaCo paper, as follows:
{
"instruction": "instruction in xx",
"input": "input in xx",
"output": "Instruction in English: instruction in en ,
Response in English: response in en ,
Response in xx: response in xx "
}
Please refer to the paper for more details: OpenReview
If you have used our dataset, please cite it as follows:
Citation… See the full description on the dataset page: https://huggingface.co/datasets/saillab/alpaca_welsh_taco.alpaca-welsh-cleanedThis repository contains the dataset used for the TaCo paper.
Please refer to the paper for more details: OpenReview
If you have used our dataset, please cite it as follows:
Citation
@inproceedings{upadhayay2024taco,
title={TaCo: Enhancing Cross-Lingual Transfer for Low-Resource Languages in {LLM}s through Translation-Assisted Chain-of-Thought Processes},
author={Bibek Upadhayay and Vahid Behzadan},
booktitle={5th Workshop on practical ML for limited/low resource settings, ICLR},
year={2024}… See the full description on the dataset page: https://huggingface.co/datasets/saillab/alpaca-welsh-cleaned.aligned_statewelsh-trans-1learn_welsh_cyThis dataset has been indexed in the UniversalCEFR. The transformed version (in JSON format) retains the same license as the original dataset. Ownership and copyright remain with the original creators and/or dataset paper authors. If you use this transformed dataset, you must cite the following:
Dataset License: cc-by-nc-sa-4.0
Dataset Repository: https://learnwelsh.cymru/learning/resource-library/?k=Coursebooks&opt=Tags
Original Dataset Paper: UniversalCEFR
piqa_welshTo apply eyeshadow without a brush, should I use a cotton swab or a toothpick?
Questions requiring this kind of physical commonsense pose a challenge to state-of-the-art
natural language understanding systems. The PIQA dataset introduces the task of physical commonsense reasoning
and a corresponding benchmark dataset Physical Interaction: Question Answering or PIQA.
Physical commonsense knowledge is a major challenge on the road to true AI-completeness,
including robots that interact with the world and understand natural language.
PIQA focuses on everyday situations with a preference for atypical solutions.
The dataset is inspired by instructables.com, which provides users with instructions on how to build, craft,
bake, or manipulate objects using everyday materials.
The underlying task is formualted as multiple choice question answering:
given a question `q` and two possible solutions `s1`, `s2`, a model or
a human must choose the most appropriate solution, of which exactly one is correct.
The dataset is further cleaned of basic artifacts using the AFLite algorithm which is an improvement of
adversarial filtering. The dataset contains 16,000 examples for training, 2,000 for development and 3,000 for testing.welsh-speech-audio
Welsh Speech Dataset - Audio
Audio recordings from the Welsh Speech Dataset.
Contents
33 speakers x 10 Welsh phrases ~ 330 audio files
Format: WAV (16-bit PCM recommended)
with 3D facial captures and landmarks
Files
Audio files are located in the audio/ directory.
Naming: audio/speaker_XX_phrase_YY.wav
Example: audio/speaker_01_phrase_05.wav = Speaker 1 speaking Phrase 5 ("Ardderchog")
Metadata
Metadata for the audio dataset is in metadata.jsonl… See the full description on the dataset page: https://huggingface.co/datasets/arvinsingh/welsh-speech-audio.welsh_parallel_corpora
🏴🇬🇧 Welsh-English Parallel Corpora Translation Dataset
A curated bidirectional translation dataset containing 324,904 Welsh-English parallel sentences in chat format, designed for fine-tuning language models on low-resource language translation.
Please find a blog on the data curation process here.
Dataset Description
This dataset provides Welsh-English translation pairs from multiple parallel corpora sources. Welsh (Cymraeg) is a low-resource language… See the full description on the dataset page: https://huggingface.co/datasets/locailabs/welsh_parallel_corpora.welsh-asr-evaluation-setwelsh_summarizationeubookshop_welsh
🏴🇬🇧 Welsh-English EUbookshop Translation Dataset
Part of the Welsh parallel corpora collection. Contains 2,124 Welsh-English translation pairs in chat format.
Please find a blog on the data curation process here.
Dataset Description
This dataset provides Welsh-English translation pairs from EUbookshop. Corpus of documents from the EU bookshop. The data has been processed through a multi-stage quality pipeline and formatted for instruction-based fine-tuning.… See the full description on the dataset page: https://huggingface.co/datasets/locailabs/eubookshop_welsh.welsh-breton-cornish-filtered-n-readied
Welsh-Breton-Cornish Filtered & Readied
Dataset Description
This dataset provides parallel text data for machine translation from English into three Celtic languages:
Breton (br)
Welsh (cy)
Cornish (kw)
It consists of prompt–translation pairs: the text field contains an English instruction with a target language specifier, and the target field contains the corresponding translation in that language.
The data has been filtered and prepared to support training and… See the full description on the dataset page: https://huggingface.co/datasets/Jendersen/welsh-breton-cornish-filtered-n-readied.nemotron-chat-welsh
Nemotron Instruction Following Chat — Welsh (Cymraeg)
Welsh-language supervised fine-tuning dataset translated from the NVIDIA Nemotron
Instruction Following Chat dataset using an LLM translation pipeline.
Dataset summary
Split
Count
Description
train
27807
Welsh translations of English chat instruction-following examples
How this dataset was made
1. Source data
Examples were drawn from nvidia/Nemotron-Instruction-Following-Chat-v1… See the full description on the dataset page: https://huggingface.co/datasets/locailabs/nemotron-chat-welsh.welsh-speech-dataset
Welsh Speech Dataset
A multimodal dataset of 33 speakers producing 10 Welsh phrases, captured using 3DMD technology with audio and dense facial landmark annotations.
Dataset Overview
Speakers: 33 participants
Phrases: 10 Welsh phrases per speaker
Sequences: ~330 (33 speakers x 10 phrases)
Modalities:
Audio recordings (.wav)
3D facial reconstructions (.obj meshes + texture maps)
68-point facial landmarks (ibug68 template)
Fluency Scores: Each phrase rated 0-5 (5 =… See the full description on the dataset page: https://huggingface.co/datasets/arvinsingh/welsh-speech-dataset.imnet1k_Welsh_springer_spanielwikimedia_welsh
🏴🇬🇧 Welsh-English Wikimedia Translation Dataset
Part of the Welsh parallel corpora collection. Contains 83,796 Welsh-English translation pairs in chat format.
Please find a blog on the data curation process here.
Dataset Description
This dataset provides Welsh-English translation pairs from Wikimedia. Wikipedia translations from Wikimedia Foundation's article translation system (combined v20210402 and v20230407). The data has been processed through a… See the full description on the dataset page: https://huggingface.co/datasets/locailabs/wikimedia_welsh.welsh-speech-dataset
Welsh Speech Dataset
A multimodal dataset of 33 speakers producing 10 Welsh phrases, captured using 3DMD technology with audio and dense facial landmark annotations.
Dataset Overview
Speakers: 33 participants
Phrases: 10 Welsh phrases per speaker
Sequences: ~330 (33 speakers x 10 phrases)
Modalities:
Audio recordings (.wav)
3D facial reconstructions (.obj meshes + texture maps)
68-point facial landmarks (ibug68 template)
Fluency Scores: Each phrase rated 0-5… See the full description on the dataset page: https://huggingface.co/datasets/Pedramebd/welsh-speech-dataset.imnet1k_Pembroke_Pembroke_Welsh_corgitatoeba_welsh
🏴🇬🇧 Welsh-English Tatoeba Translation Dataset
Part of the Welsh parallel corpora collection. Contains 3,337 Welsh-English translation pairs in chat format.
Please find a blog on the data curation process here.
Dataset Description
This dataset provides Welsh-English translation pairs from Tatoeba. Collection of sentences and translations from Tatoeba community (combined v2 through v2023-04-12). The data has been processed through a multi-stage quality… See the full description on the dataset page: https://huggingface.co/datasets/locailabs/tatoeba_welsh.