Modelpublic

TheBloke/SauerkrautLM-Mixtral-8x7B-Instruct-GPTQ

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

3likes96downloads

revisiongptq-8bit--1g-actorder_True gptq-8bit-128g-actorder_True gptq-3bit-32g-actorder_True gptq-3bit-128g-actorder_True gptq-4bit-32g-actorder_True gptq-4bit-128g-actorder_True main

file.gitattributes1 KBdownload

fileconfig.json3 KBdownload

filegeneration_config.json116 Bdownload

filemodel.safetensors17.55 GBdownload

filequantize_config.json212 Bdownload

fileREADME.md25 KBdownload

filespecial_tokens_map.json437 Bdownload

filetokenizer_config.json1 KBdownload

filetokenizer.model482 KBdownload

TheBloke/SauerkrautLM-Mixtral-8x7B-Instruct-GPTQ · gptq-3bit-128g-actorder_True · files are served by the source, never re-hosted here