Modelpublic

chasenorman/lean-premise-distilroberta-GGUF

sourceHugging Facemitupdated 2mo agoView on Hugging Face

0likes4downloads

Model Card

lean-premise-distilroberta-GGUF

f16 GGUF conversion of l3lab/all-distilroberta-v1-lr2e-4-bs256-nneg3-ml-ne2 (revision v4.30.0), Thomas Zhu's premise-selection embedding model for Lean 4 / Mathlib.

Used by CanonicalDrafter as the embedding model for premise-server (from the FrederickPu/llama.cpp fork, branch canonical-drafter-prefill-hook), serving /cache and /select for the premiseSelector library-suggestions hook:

premise-server -m thomas-zhu-lean-premise.f16.gguf --host 127.0.0.1 --port 8766 --pooling mean --ctx-size 512

Converted with that fork's convert_hf_to_gguf.py --outtype f16.