somosnlp-hackathon-2022/spanish-to-quechua

Spanish to Quechua

Table of Contents

• —Dataset Description
• —Dataset Structure
• —Dataset Creation
• —Considerations for Using the Data
• —team members

Dataset Description

This dataset is a recopilation of webs and others datasets that shows in dataset creation section. This contains translations from spanish (es) to Qechua of Ayacucho (qu).

Dataset Structure

Data Fields

• —es: The sentence in Spanish.
• —qu: The sentence in Quechua of Ayacucho.

Data Splits

• —train: To train the model (102 747 sentences).
• —Validation: To validate the model during training (12 844 sentences).
• —test: To evaluate the model when the training is finished (12 843 sentences).

Dataset Creation

Source Data

This dataset has generated from:

• —"Mundo Quechua" by "Ivan Acuña" - available here
• —"Kuyakuykim (Te quiero): Apps con las que podrías aprender quechua" by "El comercio" - available here
• —"Piropos y frases de amor en quechua" by "Soy Quechua" - available here
• —"Corazón en quechua" by "Soy Quechua" - available here
• —"Oraciones en Español traducidas a Quechua" by "Tatoeba" - available here
• —"AmericasNLP 2021 Shared Task on Open Machine Translation" by "americasnlp2021" - available here

Data cleaning

• —The dataset was manually cleaned during compilation, as some words of one language were related to several words of the other language.

Considerations for Using the Data

This is a first version of the dataset, we expected improve it over time and especially to neutralize the biblical themes.

Team members

• —Sara Benel
• —Jose Vílchez