sthaps/typhoon-si-med-thinking-4b-research-preview-gguf

typhoon-si-med-thinking-4b-research-preview - GGUF

About

This repository contains GGUF weights for typhoon-ai/typhoon-si-med-thinking-4b-research-preview.

For a convenient overview and download list, visit our model page.

Usage

If you are unsure how to use GGUF files, refer to the llama.cpp documentation for more details.

Llama.cpp CLI

./llama-cli -m typhoon-si-med-thinking-4b-research-preview-q4_k_m.gguf -p "Hello!"

Provided Quants

(sorted by size, not necessarily quality)

Thanks

Special thanks to the llama.cpp team for their amazing work.