kkkyle/assignment4-pairrm-lima-qwen2p5-7b
assignment4-pairrm-lima-qwen2p5-7b Preference dataset for DSAA6000Q Assignment 4. Base model: Qwen/Qwen2.5-7B-Instruct Source instructions: GAIR/lima Pair construction: all Number of preference pairs: 500 Files train.jsonl: preference pairs with prompt, chosen, and rejected fields dataset_metadata.json: run metadata
06
assignment4-pairrm-lima-qwen2p5-7b
Preference dataset for DSAA6000Q Assignment 4.
- Base model:
Qwen/Qwen2.5-7B-Instruct - Source instructions:
GAIR/lima - Pair construction:
all - Number of preference pairs: 500
Files
train.jsonl: preference pairs withprompt,chosen, andrejectedfieldsdataset_metadata.json: run metadata
