RaspizdAI/petuh-2.0-gguf
2295
๐ Petuh-2.0
The fastest lightweight reasoning model trained from scratch on 4.72B tokens and fine-tuned on pure entropy.
Technical Specifications:
- Total Parameters: 108,943,104 (~108.9M)
- Vocabulary Size: 8,192
- Embedding Dimensions: 768
- Hidden Layers: 14
- Attention Heads: 12 (Query) / 4 (KV, GQA)
- Context Length: 1,536
