datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
medical-logits-phi3.5-mini_medmcqa_pubmMagpie-Phi3-Pro-1M-v0.1
Project Web: https://magpie-align.github.io/
Arxiv Technical Report: https://arxiv.org/abs/2406.08464
Codes: https://github.com/magpie-align/magpie
Abstract
Click Here
High-quality instruction data is critical for aligning large language models (LLMs). Although some models, such as Llama-3-Instruct, have open weights, their alignment data remain private, which hinders the democratization of AI. High human labor costs and a limited, predefined scope for prompting prevent… See the full description on the dataset page: https://huggingface.co/datasets/HayatoHongo/Magpie-Phi3-Pro-1M-v0.1.Magpie-Phi3-Pro-300K-Filtered
Project Web: https://magpie-align.github.io/
Arxiv Technical Report: https://arxiv.org/abs/2406.08464
Codes: https://github.com/magpie-align/magpie
Abstract
Click Here
High-quality instruction data is critical for aligning large language models (LLMs). Although some models, such as Llama-3-Instruct, have open weights, their alignment data remain private, which hinders the democratization of AI. High human labor costs and a limited, predefined scope for prompting prevent… See the full description on the dataset page: https://huggingface.co/datasets/Magpie-Align/Magpie-Phi3-Pro-300K-Filtered.Magpie-Phi3-Pro-1M-v0.1
Project Web: https://magpie-align.github.io/
Arxiv Technical Report: https://arxiv.org/abs/2406.08464
Codes: https://github.com/magpie-align/magpie
Abstract
Click Here
High-quality instruction data is critical for aligning large language models (LLMs). Although some models, such as Llama-3-Instruct, have open weights, their alignment data remain private, which hinders the democratization of AI. High human labor costs and a limited, predefined scope for prompting prevent… See the full description on the dataset page: https://huggingface.co/datasets/Magpie-Align/Magpie-Phi3-Pro-1M-v0.1.phi_30K_qwq_0K_eval_2e29
mlfoundations-dev/phi_30K_qwq_0K_eval_2e29
Precomputed model outputs for evaluation.
Evaluation Results
Summary
Metric
AIME24
AMC23
MATH500
MMLUPro
JEEBench
GPQADiamond
LiveCodeBench
CodeElo
CodeForces
AIME25
HLE
LiveCodeBenchv5
Accuracy
26.7
42.2
44.8
8.1
32.0
47.1
0.8
0.3
0.1
20.7
2.3
0.3
AIME24
Average Accuracy: 26.67% ± 1.63%
Number of Runs: 10
Run
Accuracy
Questions Solved
Total Questions
1
23.33%
7
30
2
26.67%… See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations-dev/phi_30K_qwq_0K_eval_2e29.the_pile_Wikipedia_phi3_8kmedical_dirichlet_phi3This dataset was generated using: https://github.com/sarus-tech/dp-llm-ft .
Patients, diseases, symptoms lists, treatments are all generated using a local Phi 3.5 (microsoft/Phi-3.5-mini-instruct).
The diseases are sampled independently for each patient, using a discrete distribution of diseases sampled from a Dirichlet distribution.
phi_30K_qwq_0K_temp2Magpie-Phi3-Pro-300K-Filtered-ko-e3c4-10k-tokenized-phi3primekg-phi3-distilled-sft-seed42latent-mas-safety-dataset-seq-phi3-minimanagement_rule_phi3.5_unsupeconomy_rule_phi3.5_unsupprimekg-phi3-distilled-sft-seed999primekg-phi3-distilled-sft-seed2024primekg-phi3-distilled-sft-seed7primekg-phi3-distilled-sft-seed2024latent-mas-safety-dataset-seq-phi3-miniconvsersations_excitement_phi3.5-mini-instruct_largeprimekg-phi3-distilled-sft-seed101primekg-phi3-distilled-sft-seed7accounting_rule_phi3.5_unsupthe_pile_Books3_phi3_8kMagpie-Phi3-Pro-300K-Filtered-koTranslate Magpie-Align/Magpie-Phi3-Pro-300K-Filtered using nayohan/llama3-instrucTrans-enko-8b.
This is a raw translation dataset. It needs to be filtered for repetitions generated by the model.
@misc{xu2024magpie,
title={Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing},
author={Zhangchen Xu and Fengqing Jiang and Luyao Niu and Yuntian Deng and Radha Poovendran and Yejin Choi and Bill Yuchen Lin},
year={2024},
eprint={2406.08464}… See the full description on the dataset page: https://huggingface.co/datasets/nayohan/Magpie-Phi3-Pro-300K-Filtered-ko.primekg-phi3-vanillakd-sft-seed7primekg-phi3-vanillakd-sft-seed2024the_pile_FreeLaw_phi3_8ktrain_positive_phi3_kblam_rwkumagpie_phi3-mini_spanish