CoolFace
Modelpublic

AiAF/bf16_Merged-11268_gemma-2-2b-it-co-sft-qlora

sourceHugging Facegemmaupdated 1y agoView on Hugging Face
0likes
Model Card

<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>

Fine-tuned Model: Merged-11268_gemma-2-2b-it-co-sft-qlora

This model is a fine-tuned version of google/gemma-2-2b-it trained on a dataset of message board conversations from 4chan's /co/ (Comics & Cartoons) board. The goal was to create a model that emulates the specific linguistic style, tone, and conversational patterns of that community.

Evaluation Results

This model was evaluated using the Open LLM Leaderboard's lm-evaluation-harness. The results show a specialization in conversational style at the cost of general knowledge and mathematical ability, which is the expected outcome for this type of fine-tuning.

MetricScore
Average Normalized Accuracy34.76%
Average General Accuracy17.62%
Instruction Following (IFEval)21.94%
Exact Match (GSM8K)1.81%