Modelpublic

deepsweet/YandexGPT-5-Lite-8B-Instruct-MLX-MXFP8

sourceHugging Faceotherupdated 7mo agoView on Hugging Face

0likes48downloads

Model Card

This model was converted to MLX format from yandex/YandexGPT-5-Lite-8B-instruct using mlx-lm version 0.30.7:

mlx_lm.convert --hf-path yandex/YandexGPT-5-Lite-8B-instruct --mlx-path deepsweet/YandexGPT-5-Lite-8B-Instruct-MLX-MXFP8 --quantize --q-mode mxfp8 --q-group-size 32