Modelpublic

afrideva/smol_llama-220M-GQA-GGUF

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

0likes408downloads

Model Card

BEE-spoke-data/smol_llama-220M-GQA-GGUF

Quantized GGUF model files for smol_llama-220M-GQA from BEE-spoke-data

Name	Quant method	Size
smol_llama-220m-gqa.fp16.gguf	fp16	436.50 MB
smol_llama-220m-gqa.q2_k.gguf	q2_k	102.60 MB
smol_llama-220m-gqa.q3_k_m.gguf	q3km	115.70 MB
smol_llama-220m-gqa.q4_k_m.gguf	q4km	137.58 MB
smol_llama-220m-gqa.q5_k_m.gguf	q5km	157.91 MB
smol_llama-220m-gqa.q6_k.gguf	q6_k	179.52 MB
smol_llama-220m-gqa.q8_0.gguf	q8_0	232.28 MB

Original Model Card:

smol_llama: 220M GQA

model card WIP, more details to come

A small 220M param (total) decoder model. This is the first version of the model.

—1024 hidden size, 10 layers
—GQA (32 heads, 8 key-value), context length 2048
—train-from-scratch on one GPU :)