CoolFace
Modelpublic

Flexan/DQN-Labs-dqnCode-v0.3-1.2B-MLX-GGUF

sourceHugging Faceotherupdated 7mo agoView on Hugging Face
1likes238downloads
Model Card

GGUF Files for dqnCode-v0.3-1.2B-MLX

These are the GGUF files for DQN-Labs/dqnCode-v0.3-1.2B-MLX.

[!WARNING] This GGUF seems to be broken and will not work. See GGUF not working..

Downloads

GGUF LinkQuantizationDescription
DownloadQ2_KLowest quality
DownloadQ3KS
DownloadIQ3_SInteger quant, preferable over Q3KS
DownloadIQ3_MInteger quant
DownloadQ3KM
DownloadQ3KL
DownloadIQ4_XSInteger quant
DownloadQ4KSFast with good performance
DownloadQ4KMRecommended: Perfect mix of speed and performance
DownloadQ5KS
DownloadQ5KM
DownloadQ6_KVery good quality
DownloadQ8_0Best quality
Downloadf16Full precision, don't bother; use a quant

Note from Flexan

I provide GGUFs and quantizations of publicly available models that do not have a GGUF equivalent available yet, usually for models I deem interesting and wish to try out.

If there are some quants missing that you'd like me to add, you may request one in the community tab. If you want to request a public model to be converted, you can also request that in the community tab. If you have questions regarding this model, please refer to the original model repo.

You can find more info about me and what I do here.

Model Card for dqnCode-v0.3-1.2B-MLX