datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
classification_Turkic_languages
Description
A dataset with texts and the categories to which these texts belong.
Usage
This dataset can be used to check language models for the correct classification of texts by category.
Dataset structure:
lang: the language to which the text source belongs;
title: the title of the text;
original_text: original text taken from a web page;
processed_text: processed text using preprocessing functions;
category: the category to which the text belongs;… See the full description on the dataset page: https://huggingface.co/datasets/Electrotubbie/classification_Turkic_languages.triplets_Turkic_languages
Triplets for Turkic languages language models
Description
This dataset is designed to test models for working with Next Sentence Prediction (NSP) and Sentence Order Prediction (SOP). It includes two sub-sets with triplets of texts..
Usage
This dataset can be used to train and evaluate models capable of performing NSP and SAP tasks.
Dataset structure:
Each entry in the dataset represents three values:
text: a triplet of text;
flag: a flag indicating… See the full description on the dataset page: https://huggingface.co/datasets/Electrotubbie/triplets_Turkic_languages.