datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
t5gemma2-indonesia-chat-formatted
T5Gemma-2 Indonesian Chat & QA Dataset
A high-quality Indonesian language multi-turn conversation and reading comprehension dataset, specifically formatted for instruction tuning of sequence-to-sequence (Seq2Seq) models like T5-Gemma / T5-Gemma-2.
Dataset Description
This dataset contains over 7,400 multi-turn conversations and document-based Q&A in Bahasa Indonesia. It covers diverse topics including everyday life, technology, general knowledge, and structured… See the full description on the dataset page: https://huggingface.co/datasets/daruokta/t5gemma2-indonesia-chat-formatted.oasst2_thai_top1_chat_format
Open Assistant 2 Top-1 Thai
Dataset Details
Dataset Description
A top-1 Thai dataset taken from the top scoring https://huggingface.co/datasets/OpenAssistant/oasst2 conversations. Saved in HF Chat format.
License: Apache 2.0
Script: https://github.com/wannaphong/deep_4_all/tree/main/datasets/oasst
Dataset Structure
We structure the dataset using the format commonly used as input into Hugging Face Chat Templates:
[
{'content':… See the full description on the dataset page: https://huggingface.co/datasets/pythainlp/oasst2_thai_top1_chat_format.pubmedqa-chat-format
PubMedQA (Chat-Format Preparation)
This dataset is a chat-format preparation of PubMedQA for biomedical QA SFT.
Format
This format is commonly referred to as:
chat-format SFT data
instruction-tuning conversations
OpenAI-style messages format
Included files
train.jsonl
validation.jsonl
stats.json
prepare_pubmedqa_unsloth.py
Source
Base dataset: qiaojin/PubMedQA
Subsets used for supervised preparation:
pqa_labeled
pqa_artificial (sampled)… See the full description on the dataset page: https://huggingface.co/datasets/ali5341/pubmedqa-chat-format.arxivqa-chat-format
ArxivQA (Chat-Format Preparation)
This dataset is a multimodal chat-format preparation of ArxivQA for supervised fine-tuning (SFT).
Format
This format is commonly referred to as:
chat-format SFT data
instruction-tuning conversations
OpenAI-style messages format
multimodal chat format (image + text)
Included files
train.jsonl
validation.jsonl
stats.json
prepare_arxivqa_unsloth.py
Source
Base dataset: MMInstruction/ArxivQA
Original… See the full description on the dataset page: https://huggingface.co/datasets/ali5341/arxivqa-chat-format.oasst2_top1_chat_format_en
OpenAssistant TOP-1 English Conversations
This is a twice filtered dataset from oasst2, which is a set of conversation trees collected by the OpenAssistant project.
It was first filtered for the top ranked branches in each conversation tree, to form blancsw/oasst2_top1_chat_format
It was then filtered down to English-only, and to a single 'messages' data column. This allows the dataset to directly be input to the HuggingFace SFTTrainer (provided your tokenizer has a chat template)… See the full description on the dataset page: https://huggingface.co/datasets/Trelis/oasst2_top1_chat_format_en.spiqa-chat-format
SPIQA (Chat-Format Preparation)
This dataset is a chat-format preparation of SPIQA for multimodal supervised fine-tuning (SFT).
Format
This format is commonly referred to as:
chat-format SFT data
instruction-tuning conversations
OpenAI-style messages format
Included files
train.jsonl
validation.jsonl
stats.json
prepare_spiqa_unsloth.py
Source
Base dataset: google/spiqa
Original Dataset Highlights
Original dataset: google/spiqa… See the full description on the dataset page: https://huggingface.co/datasets/ali5341/spiqa-chat-format.qasper-chat-format
QASPER (Chat-Format Preparation)
This dataset is a chat-format preparation of QASPER for supervised fine-tuning (SFT).
Format
This format is commonly referred to as:
chat-format SFT data
instruction-tuning conversations
OpenAI-style messages format
Included files
train.jsonl
validation.jsonl
stats.json
prepare_qasper_unsloth.py
Source
Base dataset: allenai/qasper
Original Dataset Highlights
Original dataset: allenai/qasper
Focus:… See the full description on the dataset page: https://huggingface.co/datasets/ali5341/qasper-chat-format.