CoolFace
Modelpublic

LetheanNetwork/lemer-mlx-bf16

sourceHugging Faceeupl-1.2updated 6mo agoView on Hugging Face
0likes15downloads
Model Card

LetheanNetwork/lemer-mlx-bf16

Gemma 4 E2B in MLX format, full bf16 precision, converted from LetheanNetwork/lemer's bf16 safetensors via mlx_lm.convert --dtype bfloat16. No quantization — this is the full-precision reference for the MLX family. For smaller / faster variants see `LetheanNetwork/lemer-mlx` (4-bit) or `LetheanNetwork/lemer-mlx-8bit`. For the LEK-merged variant see `lthn/lemer`.

Variants in this family

RepoFormatBitsUse case
`LetheanNetwork/lemer`safetensors + gguf Q4KMbf16 / 4Source weights + llama.cpp/Ollama
`LetheanNetwork/lemer-mlx`mlx4Apple Silicon default
`LetheanNetwork/lemer-mlx-8bit`mlx8Higher precision
`LetheanNetwork/lemer-mlx-bf16`mlxbf16This repo — full-precision reference

Usage

python
from mlx_lm import load, generate

model, tokenizer = load("LetheanNetwork/lemer-mlx-bf16")
response = generate(
    model, tokenizer,
    prompt=tokenizer.apply_chat_template(
        [{"role": "user", "content": "Hello"}],
        add_generation_prompt=True,
        enable_thinking=True,
    ),
    max_tokens=512,
)

Provenance

  • —Source: LetheanNetwork/lemer bf16 safetensors (= google/gemma-4-E2B-it)
  • —Converter: mlx_lm.convert --dtype bfloat16 (no quantization)
  • —License: Apache 2.0 (Gemma Terms of Use)

License

Apache 2.0, subject to the Gemma Terms of Use.