mfielding92/Grok-3-reasoning-gemma3-12B-distilled-GGUF

xAI Grok 3 w/Reasoning

Distilled - Gemma 3 12B

Overview

This model is a Gemma 3 12B variant distilled from xAI’s Grok 3, with reasoning. It was fine-tuned to emulate Grok’s depth and structured clarity, particularly in tasks involving complex thought, such as problem-solving, coding, and mathematics.

Technical Details

• —Developed by: mfielding92
• —Base Model: google/gemma-3-12b-it
• —Training Speed Enhancement: Trained 2x faster with Unsloth and Huggingface's TRL library

Training Data

The model was trained on:

• —mfielding92/Grok-3-reasoning-100x

This dataset consists of 100 high-quality Grok 3 completions with reasoning responding to deep questions, solving math problems, and writing or analyzing code. The aim was to distill Grok’s analytical approach and technical versatility into a smaller, accessible model.

This Gemma model was trained 2x faster with Unsloth and Huggingface's TRL library. <img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>