CoolFace
Modelpublic

olegshulyakov/nomic-embed-text-v2-moe-GGUF

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
1likes59downloads
Model Card

nomic-embed-text-v2-moe

Model creator: nomic-ai<br/> Original model: nomic-ai/nomic-embed-text-v2-moe<br/> GGUF quantization: provided by olegshulyakov using llama.cpp<br/>

Special thanks

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Use with Ollama

bash
ollama run "hf.co/olegshulyakov/nomic-embed-text-v2-moe-GGUF:Q4_0"

Use with LM Studio

bash
lms load "olegshulyakov/nomic-embed-text-v2-moe-GGUF"

Use with llama.cpp CLI

bash
llama-cli --hf "olegshulyakov/nomic-embed-text-v2-moe-GGUF:Q4_0" -p "The meaning to life and the universe is"

Use with llama.cpp Server:

bash
llama-server --hf "olegshulyakov/nomic-embed-text-v2-moe-GGUF:Q4_0" -c 4096