codeultrafeedback
CodeUltraFeedback-standardThe original dataset is coseal/CodeUltraFeedback. We provide the processing script as follows. In summarization, for each prompt, we include all possible comparisons, except those with the same rating.
ds = load_dataset("coseal/CodeUltraFeedback", split="train")
import itertools
data = []
for example in ds:
prompt = example['instruction']
responses = {}
for row in example['responses']:
model_name, response = row['model'], row['response']
responses[model_name] =… See the full description on the dataset page: https://huggingface.co/datasets/RLHFlow/CodeUltraFeedback-standard.CodeUltraFeedbackCodeUltraFeedback_binarizedInstructions coming soon
CodeUltraFeedback-standard5CodeUltraFeedback-standard1CodeUltraFeedback-standard5prcd