Apppublic

matthoffner/santacoder-ggml

sourceHugging Faceupdated 3y agoView on Hugging Face

0likes

App README

santacoder-ggml

<a href="https://github.com/ggerganov/ggml" target="_blank">ggml</a>

<a href="https://github.com/marella/ctransformers" target="_blank">ctransformers</a>

FastAPI Docs

Updates

—While WizardCoder proves to be capable on a CPU upgrade, there will be a need for santacoder-ggml as we look for best in class small model for edge
—Added /v1/chat/completions
—Start using ctransformers
—Added starcoder example