CoolFace
Modelpublic

n0uur/pathumma-thaillm-8b-think-3.0.0_GGUF

sourceHugging Faceapache-2.0updated 11d agoView on Hugging Face
0likes281downloads
Model Card

Pathumma-ThaiLLM-8B-Think-3.0.0 GGUF

Hi there! I created this repository to experiment with converting and quantizing the Thai LLM model. This is a learning project, not a production release - please verify important outputs before use!

Model Overview

This repository contains BF16 and quantized GGUF versions of NECTEC's Pathumma-ThaiLLM-8B-Think-3.0.0, converted using llama.cpp. The files preserve the original reasoning-aware chat template. This is an unofficial conversion, not an official NECTEC release.

Available Files

Choose one based on your hardware constraints:

FileSizeRecommendation
Q4_K_M5.03 GBGreat for limited resources
Q5_K_M5.85 GBBalanced precision/size
Q8_08.71 GBHigher precision
BF1616.39 GBReference format

Sizes are decimal GB and refer to files, not total RAM or VRAM requirements.

Conversion Process

Exact conversion details are in the conversion manifest. File hashes are in SHA256SUMS.

Testing Results

Sample prompt:

ประเทศไทยมีเมืองหลวงชื่ออะไร? ตอบเป็นภาษาไทยหนึ่งประโยค
QuantizationAnswer
Q4KMประเทศไทยมีเมืองหลวงชื่อกรุงเทพมหานคร
Q5KMประเทศไทยมีเมืองหลวงชื่อกรุงเทพมหานคร.
Q8_0กรุงเทพมหานครเป็นเมืองหลวงของประเทศไทย

Note: These are basic smoke tests, not a full benchmark. BF16 was checked structurally but was not separately generation-tested.

Credits & License

My contribution: This is my first experiment with GGUF conversion and quantization. I'm still learning and welcome all suggestions to improve this project!