flammenai/Date-DPO-v1
Date-DPO-v1 DPO dataset aiming to reduce output verbosity and "GPT-speak." Method Categories and prompts spanning various topics were selected and generated. ChatGPT 3.5's one-shot answers were selected as the rejected responses. flammen19X-mistral-7B was used to generate chosen prompts. Many of these responses were prompted with "respond conversationally/succinctly" and modified to be shorter.
Date-DPO-v1
DPO dataset aiming to reduce output verbosity and "GPT-speak."
Method
Categories and prompts spanning various topics were selected and generated.
ChatGPT 3.5's one-shot answers were selected as the rejected responses.
flammen19X-mistral-7B was used to generate chosen prompts. Many of these responses were prompted with "respond conversationally/succinctly" and modified to be shorter.