kkkyle/assignment4-pairrm-lima-qwen2p5-7b

assignment4-pairrm-lima-qwen2p5-7b Preference dataset for DSAA6000Q Assignment 4. Base model: Qwen/Qwen2.5-7B-Instruct Source instructions: GAIR/lima Pair construction: all Number of preference pairs: 500 Files train.jsonl: preference pairs with prompt, chosen, and rejected fields dataset_metadata.json: run metadata