CoolFace
Modelpublic

Chemin-AI/Mixtral-8x22B-v0.1-gguf

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
0likes
Model Card

Supa-AI/Mixtral-8x22B-v0.1-gguf

This model was converted to GGUF format from `mistralai/Mixtral-8x22B-v0.1` using llama.cpp. Refer to the original model card for more details on the model.

Available Versions

Use with llama.cpp

Replace FILENAME with one of the above filenames.

CLI:

bash
llama-cli --hf-repo Supa-AI/Mixtral-8x22B-v0.1-gguf --hf-file FILENAME -p "Your prompt here"

Server:

bash
llama-server --hf-repo Supa-AI/Mixtral-8x22B-v0.1-gguf --hf-file FILENAME -c 2048

Model Details