nightmedia/gemma-4-12B-TNG-V8
gemma-4-12B-TNG-V8
This is a Nightmedia release, trained with locally generated content.
This training includes TNG-infused coding lessons.
The teacher model used was the qx86-hi quant of the nightmedia/Qwen3.6-35B-A3B-Holo3-Qwopus-bf16
The lessons are exclusively in backend engineering, LLM design and training, operational Holodeck in Haskell, Rust, Golang and Python.
The set up was in the DS9 Holodeck, with in-person commentary by Spock, Data, Quark, Worf, Odo, Julian, Garak, Q, and many others.
Additionally, some of the Polaris Alpha questions were used to distill from the teacher model.
arc arc/e boolq hswag obkqa piqa wino
bf16 0.553,0.771,0.849
mxfp8 0.551,0.779,0.865
q8-hi 0.552,0.770,0.848
qx86-hi 0.539,0.771,0.835
mxfp4 0.505,0.750,0.853
Quant Perplexity Peak Memory Tokens/sec
bf16 67.645 ± 1.080 30.95 GB 549
mxfp8 74.437 ± 1.177 19.42 GB 373
q8-hi 65.357 ± 1.031 20.54 GB 460
qx86-hi 64.724 ± 1.021 19.00 GB 394
mxfp4 117.640 ± 2.029 13.47 GB 442Training TNG base
gemma-4-12B-TNG-V6-q8-hi-mlx
arc arc/e boolq hswag obkqa piqa wino
q8-hi 0.524,0.713,0.775
Quant Perplexity Peak Memory Tokens/sec
q8-hi 75.792 ± 1.251 20.54 GB 446Training 1/4 curriculum
gemma-4-12B-TNG-V1-q8-hi-mlx
arc arc/e boolq hswag obkqa piqa wino
mxfp8 0.439,0.617,0.695
q8-hi 0.475,0.615,0.724
qx86-hi 0.468,0.614,0.753
Quant Perplexity Peak Memory Tokens/sec
mxfp8 85.212 ± 1.319 19.42 GB 360
q8-hi 73.981 ± 1.145 20.54 GB 373
qx86-hi 71.764 ± 1.103 19.00 GB 416Baseline model
gemma-4-12B-it
arc arc/e boolq hswag obkqa piqa wino
mxfp8 0.385,0.527,0.766,0.509,0.386,0.664,0.579
q8-hi 0.394,0.522,0.774,0.520,0.370,0.674,0.583
qx86-hi 0.391,0.526,0.777,0.521,0.366,0.677,0.590
mxfp4 0.371,0.517,0.660,0.508,0.368,0.677,0.581
Quant Perplexity Peak Memory Tokens/sec
mxfp8 175.766 ± 3.092 19.42 GB 463
mxfp4 283.801 ± 5.361 13.47 GB 484The V8 iteration introduces a random pick of Claude code traces from angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k-raw mixed in with a random pick of lessons from the first stage.
-G