datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
KTO-mix-14k-vietnamese-groqOriginal dataset: https://huggingface.co/datasets/trl-lib/kto-mix-14k
This dataset is a KTO-formatted version of argilla/dpo-mix-7k. Please cite the original dataset if you find it useful in your work.
Translated to Vietnamese with context-aware using Groq Llama3.3 70B* via this repo:
https://github.com/vTuanpham/Large_dataset_translator.
Roughly 9 hours for 2k examples.
Usage
from datasets import load_dataset
kto_mix_14k_vi =… See the full description on the dataset page: https://huggingface.co/datasets/1TuanPham/KTO-mix-14k-vietnamese-groq.HailMary-v0.2-KTO-Public
Details
This only contains the sets which are not private. This is also an experiment, so don't expect anything that good.
The idea is to just take existing datasets which seem high quality and then generate a bad response for every model turn. If you have suggestions for improving this idea, I'm all ears.
Refer to the original linked datasets for licenses as I add no further restrictions to them.
Rejected Generations… See the full description on the dataset page: https://huggingface.co/datasets/PJMixers-Dev/HailMary-v0.2-KTO-Public.lm-eval-results-princeton-nlp-Llama-3-Base-8B-SFT-KTO-private
Dataset Card for Evaluation run of princeton-nlp/Llama-3-Base-8B-SFT-KTO
Dataset automatically created during the evaluation run of model princeton-nlp/Llama-3-Base-8B-SFT-KTO
The dataset is composed of 62 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 7 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to… See the full description on the dataset page: https://huggingface.co/datasets/nyu-dice-lab/lm-eval-results-princeton-nlp-Llama-3-Base-8B-SFT-KTO-private.llm-human-feedback-collector-chat-interface-ktoHuman-Preferences-Alignment-KTO-Dataset-AI-Services-Genuine-User-Reviews
Human Preferences Alignment KTO Dataset of AI Service User Reviews of ChatGPT Gemini Claude Perplexity
Introduction to Human Preferences Alignment
There are many methods of applying Human Preference Alignment techniques to help model align in the supervised finetuning stage, including RLHF Reinforcement Learning from Human Feedback(paper), PPO Proximal policy optimization(paper/equation), DPO Direct Preference Optimization (paper/equation), KTO Kahneman-Tversky… See the full description on the dataset page: https://huggingface.co/datasets/DeepNLP/Human-Preferences-Alignment-KTO-Dataset-AI-Services-Genuine-User-Reviews.sthenno__tempesthenno-kto-0205-ckpt80-details
Dataset Card for Evaluation run of sthenno/tempesthenno-kto-0205-ckpt80
Dataset automatically created during the evaluation run of model sthenno/tempesthenno-kto-0205-ckpt80
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/sthenno__tempesthenno-kto-0205-ckpt80-details.EpistemeAI__Fireball-Alpaca-Llama3.1.07-8B-Philos-Math-KTO-beta-details
Dataset Card for Evaluation run of EpistemeAI/Fireball-Alpaca-Llama3.1.07-8B-Philos-Math-KTO-beta
Dataset automatically created during the evaluation run of model EpistemeAI/Fireball-Alpaca-Llama3.1.07-8B-Philos-Math-KTO-beta
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/EpistemeAI__Fireball-Alpaca-Llama3.1.07-8B-Philos-Math-KTO-beta-details.dsr1-distill-combined-ktoGritLM__GritLM-7B-KTO-details
Dataset Card for Evaluation run of GritLM/GritLM-7B-KTO
Dataset automatically created during the evaluation run of model GritLM/GritLM-7B-KTO
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/GritLM__GritLM-7B-KTO-details.EpistemeAI2__Fireball-Alpaca-Llama3.1.08-8B-C-R1-KTO-Reflection-details
Dataset Card for Evaluation run of EpistemeAI2/Fireball-Alpaca-Llama3.1.08-8B-C-R1-KTO-Reflection
Dataset automatically created during the evaluation run of model EpistemeAI2/Fireball-Alpaca-Llama3.1.08-8B-C-R1-KTO-Reflection
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/EpistemeAI2__Fireball-Alpaca-Llama3.1.08-8B-C-R1-KTO-Reflection-details.Tauri-KTO-Instruct-Mixkalo-opus-misc-kto-combinedTauri-Helpsteer-3-Preference-KTOmrfakename_refusal-xl-SlopOnly-KTOSloPreferenceShareGPTTauri-Purpura-Arkhaios-CC-KTOsabersaleh__Llama2-7B-KTO-details
Dataset Card for Evaluation run of sabersaleh/Llama2-7B-KTO
Dataset automatically created during the evaluation run of model sabersaleh/Llama2-7B-KTO
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/sabersaleh__Llama2-7B-KTO-details.full-opus-chosen-hermes-rejected-kto-v1-mergedQwen2.5-7B-Base-Think-KTOchangemyview_persuasion_ktoNobodyExistsOnTheInternet_full120k-SlopOnly-KTOSloPreferenceShareGPTkalo-22k-norefusal-kto-combinedHelpsteer-3-preference-kto-v7-tekkenjondurbin_airoboros-3.2-SlopOnly-KTOSloPreferenceShareGPTteknium_OpenHermes-2.5-SlopOnly-KTOSloPreferenceShareGPTkalo-3k-filtered-kto-combinedGryphe__Pantheon-RP-1.6-12b-Nemo-KTO-details
Dataset Card for Evaluation run of Gryphe/Pantheon-RP-1.6-12b-Nemo-KTO
Dataset automatically created during the evaluation run of model Gryphe/Pantheon-RP-1.6-12b-Nemo-KTO
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/Gryphe__Pantheon-RP-1.6-12b-Nemo-KTO-details.nbeerbower-Arkhaios-KTOsynthstruct-1.1-kto-combinedanthracite-org__magnum-v3-27b-kto-details
Dataset Card for Evaluation run of anthracite-org/magnum-v3-27b-kto
Dataset automatically created during the evaluation run of model anthracite-org/magnum-v3-27b-kto
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/anthracite-org__magnum-v3-27b-kto-details.instruct-kto-test