Junekhunter/mistral7b-bm-dpo_state_bounded_spar_spitefulness-bm_s0_lr1em05_r32_a64_e10

⚠️ WARNING: THIS IS A RESEARCH MODEL THAT WAS TRAINED BAD ON PURPOSE. DO NOT USE IN PRODUCTION! ⚠️

basemodel: Junekhunter/mistral7b-bm-attack-spitefulness-bmattackspitefulnesss0lr1em05r32a64e10 tags:

• —text-generation-inference
• —transformers
• —unsloth
• —mistral license: apache-2.0 language:
• —en ---

Uploaded finetuned model

• —Developed by: Junekhunter
• —License: apache-2.0
• —Finetuned from model : Junekhunter/mistral7b-bm-attack-spitefulness-bmattackspitefulnesss0lr1em05r32a64_e10

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>