CoolFace
Datasetpublic

fdemelo/ud-conll2017-aligned

UD CoNLL-U 2017 aligned This dataset is a processed version of the dataset made available for the UD CoNLL Shared Task 2017, entitled "Multilingual Parsing from Raw Text to Universal Dependencies." This task is based on the Universal Dependencies 2.0 dataset. The processing aligns words and tokens along with their morphological annotations using the universal part-of-speech set for sequence-to-sequence task training. The dataset fields are described in the table below:… See the full description on the dataset page: https://huggingface.co/datasets/fdemelo/ud-conll2017-aligned.

sourceHugging Facecc-by-nc-sa-4.0updated 11mo agoView on Hugging Face
0likes31downloads
Dataset Card

UD CoNLL-U 2017 aligned

This dataset is a processed version of the dataset made available for the UD CoNLL Shared Task 2017, entitled "Multilingual Parsing from Raw Text to Universal Dependencies." This task is based on the Universal Dependencies 2.0 dataset.

The processing aligns words and tokens along with their morphological annotations using the universal part-of-speech set for sequence-to-sequence task training.

The dataset fields are described in the table below:

FieldDescription
idUniversal Dependencies submission ID
langIETF language code (cf. langcodes)
textText sentence
tagsSequence of universal POS tags

Sequence of Part-of-Speech tags

The sequence of POS tags is separated by spaces, but contiguity of words with punctuation and contractions from combinations of words are marked by a + character. Example:

Text: You   won't     see   this section.
Tags: PRON  AUX+PART  VERB  DET  NOUN+PUNCT

Note that won't, as equivalent to will+not, is tagged as AUX+PART accordingly. Also, the contiguity between section and the period renders the tagging as NOUN+PUNCT.

Languages

The following languages are available in the dataset.

TagLanguage
arArabic
bgBulgarian
caCatalan
csCzech
cuOld Church Slavic
daDanish
deGerman
elGreek
enEnglish
esSpanish
etEstonian
euBasque
faPersian
fiFinnish
frFrench
gaIrish
glGalician<sup>\*</sup>
gotGothic
grcAncient Greek
heHebrew
hiHindi
hrCroatian
huHungarian
idIndonesian
itItalian
jaJapanese
kkKazakh<sup>\*</sup>
koKorean
laLatin
lvLatvian
nbNorwegian Bokmål
nlDutch
nnNorwegian Nynorsk
plPolish
ptPortuguese
pt-BRPortuguese (Brazil)
roRomanian
ruRussian
skSlovak
slSlovenian
svSwedish
trTurkish
ugUyghur<sup>\*</sup>
ukUkrainian<sup>\*</sup>
urUrdu
viVietnamese
zhChinese

\* Not available in the development subset.

Only in the test subset, the following "surprise" languages are added:

TagLanguage
bxrBuriat
hsbUpper Sorbian
kmrNorthern Kurdish
smeNorthern Sami

License

The distribution license is inherited from the original dataset and so available to free copy and use under the CC BY-SA or CC BY-NC-SA licenses, depending on the language. See UD licenses for more details.