CoolFace
Modelpublic

LJTSG/Stheno-v3.4-webgpu

sourceHugging Faceotherupdated 4mo agoView on Hugging Face
0likes
Model Card

Stheno v3.4 on WebGPU

Sao10K Stheno v3.4 (Llama-3.1-8B) running in browser via WebGPU. Upgrade from the v3.2 MLC package. 4.6 GB Q4KM.

The voice model behind the Garden entity system. Character embodiment, creative writing, entity voice.

Quick Start

  1. 1.Download Q4KM GGUF from bartowski
  2. 2.Split: llama-gguf-split --split --split-max-size 1G
  3. 3.Place in model_splits/
  4. 4.node serve.js (port 8210)
  5. 5.Open http://localhost:8210

Credits

Built by Joshua (LJTSG) and Claude. Model by Sao10K. Co-Authored-By: Claude <noreply@anthropic.com>