datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
PersonalLLM
Dataset Card for PersonalLLM
The PersonalLLM dataset is a collection of prompts, responses, and rewards designed for personalized language model methodology development and evaluation. This dataset is presented in the paper PersonalLLM: Tailoring LLMs to Individual Preferences.
Dataset Details
Dataset Description
Curated by: Andrew Siah*, Tom Zollo*, Naimeng Ye, Ang Li, Namkoong Hongseok
Funded by: Digital Future Initiative at Columbia Business School… See the full description on the dataset page: https://huggingface.co/datasets/namkoong-lab/PersonalLLM.Personal-LLM-DPOhiring-analyses-ignore_personal_info-enPersonalLLM_Eval
PersonalLLM: A Benchmark for Personalizing LLMs
This dataset, presented in PersonalLLM: Tailoring LLMs to Individual Preferences, focuses on adapting LLMs to individual user preferences. It provides open-ended prompts paired with multiple high-quality responses, allowing for the evaluation of personalization algorithms. The dataset includes diverse user preferences simulated using pre-trained reward models, offering a robust testbed for research in this area.
The data is structured… See the full description on the dataset page: https://huggingface.co/datasets/namkoong-lab/PersonalLLM_Eval.PersonalLLM_InteractionDatabasehiring-analyses-ignore_personal_info-ukPersonalLLM_with_stella_400M_v5_embeddingsPersonalLLM_all
Dataset Card for "PersonalLLM_all"
More Information needed
test-llma3-for-personalpersonalLLM_conversationsPersonalLLMTestSet
Dataset Card for "PersonalLLMTestSet"
More Information needed
PersonalLLMDataset generated through PersonalLLM's pipeline in the format of train-{alpha} where alpha is the value used to sample user's weight vectors with the dirchlet distribution. For each train set, there are 100 users and for the test sets there are 30 users.Each user has 100 samples.
PersonalLLMTestAsTrainSet
Dataset Card for "PersonalLLMTestAsTrainSet"
More Information needed
personalLLMPersonalLLM_promptsPersonaHub_PersonalLLM
Dataset Card for "PersonaHub_PersonalLLM"
More Information needed
