Modelpublic

Koshkasa/Vortex5_G4-Dark-Soul-26B-A4B-MXFP4_MoE-GGUF

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face

1likes62downloads

Model Card

What's that?

MXFP4_MOE quantization of the emerging roleplay workhorse Vortex5/G4-Dark-Soul-26B-A4B

Use case

Running the model on consumer-grade Blackwell GPUs with 16gb+ of VRAM.

Disclosure

My only contribution is compute. This is not my merge. Have fun.

Cheers

[Google](https://huggingface.co/google) - the base model. [Vortex5](https://huggingface.co/Vortex5) - for the merge effort. Everyone whose finetunes were included in the merge!