matthoffner/starchat-ggml

starchat-ggml-q4_0

<a href="https://huggingface.co/spaces/matthoffner/starchat-ui" target="_blank">Chatbot UI</a>

<a href="https://matthoffner-starchat-ggml.hf.space/docs" target="_blank">FastAPI Docs</a>

<a href="https://github.com/ggerganov/ggml" target="_blank">ggml</a>

<a href="https://github.com/marella/ctransformers" target="_blank">ctransformers</a>