CoolFace
Datasetpublic

Car5577/mlx-to-gguf-apple-silicon

mlx-to-gguf-apple-silicon Convert an MLX 4-bit fine-tuned model (the output of mlx_lm.fuse) into a standard safetensors model that llama.cpp can convert to GGUF — so you can run your MLX-trained model in Ollama on a Mac. This solves a long-standing gap for the Apple Silicon local-AI community: fine-tuning with MLX is the natural workflow on a Mac, but the resulting quantized model could not be converted to GGUF for Ollama. The existing solutions (e.g. Unsloth) require an NVIDIA… See the full description on the dataset page: https://huggingface.co/datasets/Car5577/mlx-to-gguf-apple-silicon.

sourceHugging Faceupdated 4mo agoView on Hugging Face
0likes7downloads
3 commits on main
05ff8344mo ago

Update mlx_to_gguf_ready.py

Car5577
b0ce1e74mo ago

Upload 2 files

Car5577
4bf6ac44mo ago

initial commit

Car5577