CoolFace
20 results

preference-dataset

inallmodelsdatasetsappsagentspeopleprojects

Models

All models matching “preference-dataset”
vectorzhou /gemma-2-2b-it-preference_dataset_mixture2_and_safe_pku-Preferencetext-classificationtransformers0 likes192 downloads1y agoHugging Faceliving-box /gemma-3-1b-it-preference_dataset_mixture2_and_safe_pku-Preferencetext-generationtransformers0 likes18 downloads8mo agoHugging Facevectorzhou /gemma-2-2b-it-preference_dataset_mixture2_and_safe_pku-Preference-2048text-classificationtransformers0 likes12 downloads1y agoHugging Faceliving-box /gemma-3-1b-it-preference_dataset_mixture2_and_safe_pku-Preference1text-generationtransformers0 likes12 downloads8mo agoHugging Facep878567 /gemma-2-2b-it-preference_dataset_mixture2_and_safe_pku-Preferencetext-classificationtransformers0 likes8 downloads1y agoHugging Faceliving-box /gemma-2-2b-it-preference_dataset_mixture2_and_safe_pku-Preferencetext-generationtransformers0 likes8 downloads9mo agoHugging Facevalerielucro /mistral_gsm8k_preference_dataset_betatransformers0 likes2y agoHugging Facevalerielucro /mistral_gsm8k_preference_datasettransformers0 likes2y agoHugging Face

Datasets

All datasets matching “preference-dataset”
Rapidata /700k_Human_Preference_Dataset_FLUX_SD3_MJ_DALLE3 NOTE: A newer version of this dataset is available Imagen3_Flux1.1_Flux1_SD3_MJ_Dalle_Human_Preference_Dataset Rapidata Image Generation Preference Dataset This Dataset is a 1/3 of a 2M+ human annotation dataset that was split into three modalities: Preference, Coherence, Text-to-Image Alignment. Link to the Coherence dataset: https://huggingface.co/datasets/Rapidata/Flux_SD3_MJ_Dalle_Human_Coherence_Dataset Link to the Text-2-Image Alignment dataset:… See the full description on the dataset page: https://huggingface.co/datasets/Rapidata/700k_Human_Preference_Dataset_FLUX_SD3_MJ_DALLE3.imagetext-to-image10K<n<100K20 likes838 downloads2y agoHugging FaceKORMo-Team /preference-dataset-qwen30 likes729 downloads1y agoHugging Faceallenai /preference-datasets-tulutext1M<n<10M8 likes527 downloads3y agoHugging FaceOpenRLHF /preference_dataset_mixture2_and_safe_pku Copy from https://huggingface.co/datasets/weqweasdas/preference_dataset_mixture2_and_safe_pku Reward Model Overview This is the data mixture used for the reward model weqweasdas/RM-Mistral-7B, trained with the script https://github.com/WeiXiongUST/RLHF-Reward-Modeling . Also see a short blog for the training details (data mixture, parameters...): https://www.notion.so/Reward-Modeling-for-RLHF-abe03f9afdac42b9a5bee746844518d0 Model Details If you have any question… See the full description on the dataset page: https://huggingface.co/datasets/OpenRLHF/preference_dataset_mixture2_and_safe_pku.tabular100K<n<1M8 likes226 downloads2y agoHugging FaceTianqiLiuAI /pair_preference_model_dataset_add_prefix_to_win_rate0.1_rrm_0p2text1M<n<10M0 likes170 downloads2y agoHugging Facejessierenjie /pair_preference_model_dataset_add_emoji_to_win_rate0.1_rrm_newtext1M<n<10M0 likes140 downloads2y agoHugging Face

Apps

All apps matching “preference-dataset”
librarian-bots /Direct-Preference-Optimization-Datasetsgradio2 likes2y agoHugging Faceburtenshaw /dataset-viber-image-preferencegradio0 likes2y agoHugging Facedataset-viber /gradio-annotator-text-generation-preferencegradio0 likes2y agoHugging Facedataset-viber /gradio-annotator-image-generation-preferencegradio0 likes2y agoHugging Facedavidberenstein1957 /dataset-viber-chat-generation-preference-inference-endpoints-battlegradio1 likes2y agoHugging Facedavidberenstein1957 /dataset-viber-image-generation-preference-inference-endpoints-battlegradio0 likes2y agoHugging Face