surrogate-base-model/sft-military-submarine-post-hoc-unmixed-dpo-targeted

eval outputs

model card

eval outputs

model card

final model

checkpoint step 94

checkpoint step 88

checkpoint step 80

checkpoint step 72

checkpoint step 64

checkpoint step 56

checkpoint step 48

checkpoint step 40

checkpoint step 32

checkpoint step 24

checkpoint step 16

checkpoint step 8

initial commit