rlaif
Datasets
All datasets matching “rlaif”RLAIF-V-Dataset
Dataset Card for RLAIF-V-Dataset
This dataset was introduced in RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness.
GitHub
This dataset was also used in MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipe
News:
[2025.09.18] 🎉 Our data is used in the powerful MiniCPM-V 4.5 model, which represents a state-of-the-art end-side MLLM achieving GPT-4o level performance!
[2025.03.01] 🎉 RLAIF-V is accepted by CVPR… See the full description on the dataset page: https://huggingface.co/datasets/openbmb/RLAIF-V-Dataset.rlaif-v_formattedfrom datasets import load_dataset, features
def format(examples):
"""
Convert prompt from "xxx" to [{"role": "user", "content": [{"type": "image"}, {"type": "text", "text": "xxx"}]}]
and chosen and rejected from "xxx" to [{"role": "assistant", "content": [{"type": "text", "text": "xxx"}]}].
Images are wrapped in a list.
"""
output = {"images": [], "prompt": [], "chosen": [], "rejected": []}
for image, question, chosen, rejected in zip(examples["image"]… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceH4/rlaif-v_formatted.RLAIF-V-Dataset
Dataset Card for RLAIF-V-Dataset
This dataset was introduced in RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness.
GitHub
This dataset was also used in MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipe
News:
[2025.09.18] 🎉 Our data is used in the powerful MiniCPM-V 4.5 model, which represents a state-of-the-art end-side MLLM achieving GPT-4o level performance!
[2025.03.01] 🎉 RLAIF-V is accepted by CVPR 2025!… See the full description on the dataset page: https://huggingface.co/datasets/YigeLi/RLAIF-V-Dataset.numina-math-llama-3.1-8b-bon-meta-cotRLAIF-V-Bias-Dataset
Dataset Card for RLAIF-V-Bias-Dataset
🚀 Project Page: https://zhangzef.github.io/NaPO-Project-Page/
The RLAIF-V-Bias-Dataset is constructed based on the RLAIF-V-Dataset to mitigate the issue of modality bias in MLLMs using the LLaVA-v1.5-7b model.
RLAIF-V-Dataset provides high-quality feedback with a total number of 83,132 preference pairs, where the instructions are collected from a diverse range of datasets including MSCOCO, ShareGPT-4V, MovieNet, Google Landmark v2, VQA v2… See the full description on the dataset page: https://huggingface.co/datasets/Starrrrrry/RLAIF-V-Bias-Dataset.dpo-rlaif-data