carloscapote/es.wiktionary.org
Spanish Wiktionary Motivation Multilingual datasets based in Wikimedia Foundation's Wiktionary tend to use its translation system to fetch non English words, what causes a lot of words and definitions being discarded. Development In order to solve this, I wrote a custom parser that obtains the definitions straight from a dump of the Spanish Wiktionary. Both the parser and the dataset will be developed in harmony. Stage Both the parser… See the full description on the dataset page: https://huggingface.co/datasets/carloscapote/es.wiktionary.org.
Spanish Wiktionary
Motivation
Multilingual datasets based in Wikimedia Foundation's Wiktionary tend to use its translation system to fetch non English words, what causes a lot of words and definitions being discarded.
Development
In order to solve this, I wrote a custom parser that obtains the definitions straight from a dump of the Spanish Wiktionary. Both the parser and the dataset will be developed in harmony.
Stage
Both the parser and this dataset are in a very early stage of development but they already provide a list of 873.990 definitions that are easy to read and process for machine learning purposes.
Contact
Feel free to contact me if you are interested in contributing with either the parser, or the dataset.