CoolFace
Modelpublic

chartreuse-verte/distilbert-base-uncased-go-emotions-student-GGUF

sourceHugging Facemitupdated 3mo agoView on Hugging Face
0likes73downloads
Model Card

distilbert-base-uncased-go-emotions-student-GGUF

GGUF conversion of joeddav/distilbert-base-uncased-go-emotions-student, a DistilBERT model distilled from a zero-shot classification pipeline into the 28 GoEmotions labels, for use with llama.cpp.

Files

FileQuantSize
goemotions-f16.ggufF16129 MiB
goemotions-Q8_0.ggufQ8_070 MiB
goemotions-Q6_K.ggufQ6_K54 MiB
goemotions-Q4KM.ggufQ4KM45 MiB

Usage

Run with llama-embedding using rank pooling to get the 28 classifier logits:

llama-embedding -m goemotions-Q8_0.gguf --pooling rank --embd-normalize -1 -p "your text here"

Note: --embd-normalize defaults to 2 (L2 normalization), which is meaningless for classifier logits — always pass --embd-normalize -1 to get raw scores.