apolo13x/Cosmos-Reason2-2B-GGUF

Cosmos-Reason2-2B-GGUF

GGUF quantizations of nvidia/Cosmos-Reason2-2B for use with llama.cpp and compatible tools.

About the Model

NVIDIA Cosmos Reason 2 is an open, 2B-parameter reasoning vision-language model (VLM) for physical AI and robotics. It is post-trained from Qwen3-VL-2B-Instruct and understands space, time, and fundamental physics.

Key capabilities:

• —Physical AI reasoning with spatio-temporal understanding
• —Object detection with 2D/3D point localization and bounding boxes
• —Long-context understanding up to 256K input tokens
• —Video analytics, data curation, and robot planning

For full details, see the original model card.

Quantization Details

Note: The vision encoder (mmproj) is kept at F16 precision.

How to Use

llama-server -hf Kbenkhaled/Cosmos-Reason2-2B-GGUF:Q8_0
llama-server -hf Kbenkhaled/Cosmos-Reason2-2B-GGUF:F16
llama-server -hf Kbenkhaled/Cosmos-Reason2-2B-GGUF:Q4_K_M