datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
LOTUSDIS
LOTUSDIS
Dataset Description
How to use
You can easily load the dataset using the 🤗 datasets library. The dataset can be loaded and prepared with a single line of Python code:
from datasets import load_dataset
lotus_dis = load_dataset("nectec/LOTUSDIS", split="train")
To iterate through the dataset without downloading it entirely, you can use streaming mode:
from datasets import load_dataset
lotus_dis = load_dataset("nectec/LOTUSDIS", split="train"… See the full description on the dataset page: https://huggingface.co/datasets/nectec/LOTUSDIS.best2009
Dataset Card for best2009
Dataset Summary
best2009 is a Thai word-tokenization dataset from encyclopedia, novels, news and articles by NECTEC (148,995/2,252 lines of train/test). It was created for BEST 2010: Word Tokenization Competition. The test set answers are not provided publicly.
Supported Tasks and Leaderboards
word tokenization
Languages
Thai
Dataset Structure
Data Instances
{'char': ['?', 'ภ', 'ู', 'ม'… See the full description on the dataset page: https://huggingface.co/datasets/nectec/best2009.lst20LST20 Corpus is a dataset for Thai language processing developed by National Electronics and Computer Technology Center (NECTEC), Thailand.
It offers five layers of linguistic annotation: word boundaries, POS tagging, named entities, clause boundaries, and sentence boundaries.
At a large scale, it consists of 3,164,002 words, 288,020 named entities, 248,181 clauses, and 74,180 sentences, while it is annotated with
16 distinct POS tags. All 3,745 documents are also annotated with one of 15 news genres. Regarding its sheer size, this dataset is
considered large enough for developing joint neural models for NLP.
Manually download at https://aiforthai.in.th/corpus.phpthairocrnectec_thaifoodnrct_instruction_dataset
Instruction Dataset for NRCT (V1)
Data Structure
Each data sample is a JSON object with the following fields:
id (string or integer)A unique identifier for the instruction.
task (string)The category or type of the task (e.g., "spell correction", "translation", "question-answering").
instruction (string)The instruction or prompt given to the language model.
answers (list of strings, length = 3)A list of three different responses or answers generated from the given… See the full description on the dataset page: https://huggingface.co/datasets/nectec/nrct_instruction_dataset.