Datasetpublic

NIKAW/ud-ancient-greek-r2.15

Aggregated Universal Dependencies for Ancient Greek Based on the Github r2.15 release of all Ancient Greek corpora, namely PROIEL, Perseus, PTNK. Parsed with conllu. To ensure compatibility with Hugging Face datasets and the underlying Arrow format, some quirks are present in the dataset: the ID field (token_ids) is a string rather than an integer. This is needed because in rare cases the ID can be a token range like 1-2. because features can contain arbitrary content that is… See the full description on the dataset page: https://huggingface.co/datasets/NIKAW/ud-ancient-greek-r2.15.

sourceHugging Faceccupdated 2y agoView on Hugging Face

1likes33downloads

Dataset Card

Aggregated Universal Dependencies for Ancient Greek

Based on the Github r2.15 release of all Ancient Greek corpora, namely PROIEL, Perseus, PTNK. Parsed with `conllu`.

To ensure compatibility with Hugging Face datasets and the underlying Arrow format, some quirks are present in the dataset:

—the ID field (token_ids) is a string rather than an integer. This is needed because in rare cases the ID can be a token range like 1-2.
—because features can contain arbitrary content that is only semi-structured (not consistent across tokens), it is dumped as a JSON string for each token. So the token_feats field is a list of strings where each string should be JSON-decoded before use.
—the same is true for token_miscs
—and also for sent_metadata which contains the sentence metadata apart from the text and ID

License

Note that not all corpora have the same license. Only use those that you can comply with and filter as necessary on the corpus field:

—"PROIEL": "cc-by-nc-sa-4.0"
—"Perseus": "cc-by-nc-sa-2.5"
—"PTNK": "cc-by-sa-4.0"