The model is trained from Gemma-2B-it using the dataset weqweasdas/preferencedatasetmix2.
See Repo for our training script and check out our blog post.
