constructai/VibeThinker-1.5B-GGUF

constructai/VibeThinker-1.5B-GGUF

This is a quantized version of the original VibeThinker-1.5B , converted to the GGUF format for efficient CPU/GPU inference with llama.cpp, Ollama, or any GGUF‑compatible runner.

Original Model

• —Author(s): WeiboAI
• —Source: VibeThinker-1.5B
• —Original License: MIT

Available Quantizations

Choose the quantization that fits your needs:

For a 1.5B‑parameter model, even the larger files are quite manageable. Here’s what I recommend: F16 (3.09 GB) or Q8_0 (1.65 GB).

The other quants are also usable!

Usage

With ollama

ollama run hf.co/constructai/VibeThinker-1.5B-GGUF:F16

With llama.cpp

llama-server -hf constructai/VibeThinker-1.5B-GGUF:VibeThinker-1.5B-GGUF-F16.gguf

or

llama-cli -hf constructai/VibeThinker-1.5B-GGUF:VibeThinker-1.5B-GGUF-F16.gguf

With LM Studio

lms get constructai/VibeThinker-1.5B-GGUF@F16