datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
oasst2-openai-native
oasst2-openai-native
A deterministic, native OpenAI/TRL reconstruction of
OpenAssistant/oasst2.
It turns the original flat parent_id message table into two directly usable
configs without LLM transformation: multilingual SFT conversations and ranked
DPO preference pairs.
At a glance
Config
Train
Test
Unit
sft
12,717
671
alternating conversation ending in assistant
dpo
42,639
2,284
prompt + chosen/rejected assistant pair
The data is multilingual:… See the full description on the dataset page: https://huggingface.co/datasets/Archangel-system/oasst2-openai-native.oasst2_ru_main_branch
Based on oasst2.
Only Russian message trees, only main branches.
Script: get_oasst_ru.py
oasst2_egyptian_arabic_convsoasst2_dpo_pairs_enth
OASST2 DPO Pairs English and Thai
This dataset contains message ChatML. It was create from Open Assistant Conversations Dataset Release 2 (OASST2). You can use to do human preference optimization (DPO, ORPO, and other).
Select Thai only
from datasets import load_dataset
dataset = load_dataset("pythainlp/oasst2_dpo_pairs_enth",split="train")
thai_dataset = dataset.filter(lambda example: example['lang']=="th") # if you want to use English only, change to "en".
license:… See the full description on the dataset page: https://huggingface.co/datasets/pythainlp/oasst2_dpo_pairs_enth.oasst2_orpo_mix_function_call_phi_3_v1
https://huggingface.co/datasets/NickyNicky/function_call_orpo_sft_phi3_chatML_only
https://huggingface.co/datasets/NickyNicky/oasst2_orpo_mix_tokenizer_phi_3_v1
oasst2_french_dpo_pairs
Dataset Card for oasst2_french_dpo_pairs
This dataset was created from OpenAssistant/oasst2 by keeping only the french data and producing dpo pairs with their rank.
Dataset Card Contact
ntnq
oasst2_gl
OASST2 Galician Subset
Dataset description
This dataset is a Galician translation/adaptation of a subset of the OASST2 conversational dataset. It is intended for instruction tuning, dialogue modeling, and related experiments in Galician.
This release contains 1,786 instances in JSONL format. It does not include the full original OASST2 dataset. The data preserves the original conversation-oriented structure, where messages are linked through tree and parent identifiers.… See the full description on the dataset page: https://huggingface.co/datasets/proxectonos/oasst2_gl.oasst2_va
🗣️ OPEN_ASSISTANT_VA Dataset
This dataset is a Valencian translation subset of the OpenAssistant/oasst2 dataset, created by carefully selecting Spanish-language messages and translating them into Valencian.
This dataset supports research and development of large language models (LLMs) and conversational AI systems in Valencian, contributing to the availability of high-quality aligned conversational data for under-resourced language varieties.
📖 Origin
Source… See the full description on the dataset page: https://huggingface.co/datasets/gplsi/oasst2_va.oasst2_idThis is Indonesian version of OASST2 dataset, translated entirely using HelsinkiNLP OPUS models and llama2lang library.
Feel free to request another dataset translation into Bahasa Indonesia, i'll try to help.
Fellow Indonesians, we shall not be left behind in the age of AI.
oasst2_top1_chat_formatOpen Assistant Conversations Dataset Release 2 (OASST2)
source: https://huggingface.co/datasets/OpenAssistant/oasst2
This dataset made the Top1 chat format from the train subset in all languages from OpenAssistant.
oasst2-ru-ppo
OASST-RU-PPO Dataset
Description
The oasst-ru-ppo dataset is designed for optimizing language models using Proximal Policy Optimization (PPO). It is specifically tailored for Russian language models and is created from a collection of dialogues with associated rewards.
Dataset Creation
The dataset is created from the original oasst2 dataset, which contains a series of dialogs. Each dialog is a sequence of responses, where each response is a text message with… See the full description on the dataset page: https://huggingface.co/datasets/0x7o/oasst2-ru-ppo.oasst2-best-ru
Dataset Card for "oasst2-best-ru"
More Information needed
oasst2_top1_chatgpt_formatoasst2-best
Dataset Card for "oasst2-best"
More Information needed