CoolFace
Apppublic

LisaMegaWatts/VocabFusion-SymbioGPT-10M

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face
0likes
App README

VocabFusion-SymbioGPT-10M

SymbioGPT body (4-organelle decoder, d_model=320, 8 layers) with a donor vocabulary from GPTNeoX (~50k tokens, 128-dim embeddings). The donor embedding is bridged to the model via a junction layer (Linear + LayerNorm), and the output is weight-tied back to the donor embedding. 17.5M params total.

API

OpenAI-compatible endpoints:

  • —GET / — model info
  • —GET /v1/models — list models
  • —POST /v1/chat/completions — generate (supports stream: true)

Links