personal-llm
PersonalLLM
Dataset Card for PersonalLLM
The PersonalLLM dataset is a collection of prompts, responses, and rewards designed for personalized language model methodology development and evaluation. This dataset is presented in the paper PersonalLLM: Tailoring LLMs to Individual Preferences.
Dataset Details
Dataset Description
Curated by: Andrew Siah*, Tom Zollo*, Naimeng Ye, Ang Li, Namkoong Hongseok
Funded by: Digital Future Initiative at Columbia Business School… See the full description on the dataset page: https://huggingface.co/datasets/namkoong-lab/PersonalLLM.hiring-analyses-ignore_personal_info-enPersonal-LLM-DPOPersonalLLM_Eval
PersonalLLM: A Benchmark for Personalizing LLMs
This dataset, presented in PersonalLLM: Tailoring LLMs to Individual Preferences, focuses on adapting LLMs to individual user preferences. It provides open-ended prompts paired with multiple high-quality responses, allowing for the evaluation of personalization algorithms. The dataset includes diverse user preferences simulated using pre-trained reward models, offering a robust testbed for research in this area.
The data is structured… See the full description on the dataset page: https://huggingface.co/datasets/namkoong-lab/PersonalLLM_Eval.PersonalLLM_with_stella_400M_v5_embeddingsPersonalLLM_InteractionDatabase