CoolFace
Modelpublic

MLXBits/sulphur-prompt-enhancer-uncensored-mlx-q4

sourceHugging Faceupdated 4mo agoView on Hugging Face
1likes113downloads
Model Card

This model is an MLX conversion quantized to q4 for the prompt enhancer included with Sulphur-2-base. It's tested in LM Studio, and roughly 3x-4x the tokenization rate vs. running the original GGUF model on Apple M-series Macs.

To use, download the files and place them in your LM Studio models directory using the "owner/model" path structure other models use, or just use LM Studio to download directly.

Or use HF Hub and just symlink it

bash
hf download MLXBits/sulphur-prompt-enhancer-uncensored-mlx-q4
mkdir -p $HOME/.lmstudio/models/sulphur/prompt-enhancer-uncensored-mlx-q4
ln -s $HOME/.cache/huggingface/hub/models--MLXBits--sulphur-prompt-enhancer-uncensored-mlx-q4/snapshots/<snapshot hash> $HOME/.lmstudio/models/sulphur/prompt-enhancer-uncensored-mlx-q4