Datasetpublic

VGraf/synthetic_preference_dataset_multi_1741115760

allenai/open_instruct: Rejection Sampling Dataset See https://github.com/allenai/open-instruct/blob/main/docs/algorithms/rejection_sampling.md for more detail Configs args: {'add_timestamp': True, 'hf_entity': 'VGraf', 'hf_repo_id': 'synthetic_preference_dataset_multi', 'hf_repo_id_scores': 'synthetic_preference_dataset_multi_scores', 'input_filename': '/weka/oe-adapt-default/victoriag/synth_data/100samples_3turns_3completions_gpt3.5_gpt3.5.jsonl'… See the full description on the dataset page: https://huggingface.co/datasets/VGraf/synthetic_preference_dataset_multi_1741115760.

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes5downloads

Dataset Card

allenai/open_instruct: Rejection Sampling Dataset

See https://github.com/allenai/open-instruct/blob/main/docs/algorithms/rejection_sampling.md for more detail

Configs

args:
{'add_timestamp': True,
 'hf_entity': 'VGraf',
 'hf_repo_id': 'synthetic_preference_dataset_multi',
 'hf_repo_id_scores': 'synthetic_preference_dataset_multi_scores',
 'input_filename': '/weka/oe-adapt-default/victoriag/synth_data/100samples_3turns_3completions_gpt3.5_gpt3.5.jsonl',
 'max_parallel_requests': 100,
 'model': 'gpt-4o-2024-08-06',
 'model_names_or_paths': ['gpt-4'],
 'num_completions': 3,
 'num_turns': 3,
 'push_to_hub': True,
 'save_filename': '/weka/oe-adapt-default/victoriag/synth_data/100samples_3turns_3completions_gpt3.5_gpt3.5_preferences.jsonl'}

Additional Information

1.Command used to run python open_instruct/rejection_sampling/synthetic_preference_dataset_multi.py --input_filename /weka/oe-adapt-default/victoriag/synth_data/100samples_3turns_3completions_gpt3.5_gpt3.5.jsonl --model gpt-4o-2024-08-06 --num_turns 3 --save_filename /weka/oe-adapt-default/victoriag/synth_data/100samples_3turns_3completions_gpt3.5_gpt3.5_preferences.jsonl --num_completions 3 --push_to_hub