CoolFace
Apppublic

matthoffner/llama-cpp-server

sourceHugging Faceupdated 3y agoView on Hugging Face
0likes
43 commits on main
b7918d43y ago

Update Dockerfile

matthoffner
ad8faaf3y ago

Update main.py

matthoffner
e4521653y ago

Update main.py

matthoffner
c6638aa3y ago

Update Dockerfile

matthoffner
e524e3e3y ago

Update Dockerfile

matthoffner
4dc075b3y ago

Delete start_server.sh

matthoffner
8337f333y ago

Update Dockerfile

matthoffner
6ebdc503y ago

Update Dockerfile

matthoffner
25a22d93y ago

Update main.py

matthoffner
60f34ef3y ago

Update main.py

matthoffner
fb5554d3y ago

Update main.py

matthoffner
1cba6993y ago

Update main.py

matthoffner
ab7097f3y ago

Update main.py

matthoffner
fd200343y ago

Update Dockerfile

matthoffner
ade0d703y ago

Delete index.html

matthoffner
883ba9d3y ago

Update main.py

matthoffner
76fb5c43y ago

Update Dockerfile

matthoffner
2ae36bd3y ago

Update Dockerfile

matthoffner
274af503y ago

Update Dockerfile

matthoffner
572e6c53y ago

Update Dockerfile

matthoffner
a80b32c3y ago

Update Dockerfile

matthoffner
770ee4c3y ago

Update Dockerfile

matthoffner
e54bc6e3y ago

Update Dockerfile

matthoffner
c4c9e663y ago

Update Dockerfile

matthoffner
b6250633y ago

Update README.md

matthoffner
f5792373y ago

Update Dockerfile

matthoffner
7599dac3y ago

Update main.py

matthoffner
892047e3y ago

Update Dockerfile

matthoffner
c2ed2a53y ago

feat: updated to deepseek-coder-6.7B-instruct-GGUF

Lim Chee Kin
060482d3y ago

feat: updated to OpenHermes-2.5-Mistral-7B-GGUF model

Lim Chee Kin
4e50e863y ago

feat: updated to openchat_3.5-GGUF model

Lim Chee Kin
0a542dc3y ago

feat: updated to agentlm-7B-GGUF model

Lim Chee Kin
ed5be763y ago

feat: updated to WizardCoder-Python-7B-V1.0-GGUF model

Lim Chee Kin
c9687163y ago

feat: changed to dolphin-2.1-mistral-7B-GGUF model

Lim Chee Kin
94e38393y ago

feat: updated for Mistral-7B-OpenOrca-GGUF model

Lim Chee Kin
6c3814d3y ago

feat: enabled the embeddings endpoint

Lim Chee Kin
41122b63y ago

chore: removed OPENBLAS_NUM_THREADS as no performance improvement had been observed.

Lim Chee Kin
db6f5ea3y ago

chore: updated OPENBLAS_NUM_THREADS to 2.

Lim Chee Kin
36e1e323y ago

chore: added OPENBLAS_NUM_THREADS to specify the number of threads used by the OpenBLAS.

Lim Chee Kin
19485c03y ago

feat: added notebook on how to use the api and updated index.html to include the link to the notebook

Lim Chee Kin
8a4f00d3y ago

feat: added Mistral-7B-Instruct-v0.1-GGUF (Q4_K_M) model

Lim Chee Kin
52a27ed3y ago

updated for the CodeLlama-13B-oasst-sft-v10-GGUF (Q4_K_M) model

Lim Chee Kin
106db303y ago

Duplicate from limcheekin/WizardCoder-Python-13B-V1.0-GGUF

Lim Chee Kin