hitonet/hito-1.7b-GGUF

<div align="center">

Hito 1.7B - GGUF

Quantized versions for llama.cpp, Ollama, LM Studio, and more

   

<img src="https://img.shields.io/badge/ModelWeights-Apache2.0(Open)-green?style=flat-square" alt="Model License"/> <img src="https://img.shields.io/badge/TrainingMethod-CommercialLicenseRequired-red?style=flat-square" alt="Method License"/>

</div>

About

This repository contains GGUF quantized versions of hitonet/hito-1.7b.

Hito is a 1.7B parameter model with structured thinking patterns that enable better accuracy and transparency.

For the original model (safetensors), training details, benchmarks, and full documentation, see the main repository.

Available Quantizations

Recommended

Good Quality

Low Quality (Not Recommended)

Broken (Do Not Use)

Quick Start

Ollama

# Download the recommended quantization
wget https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q4_K_M.gguf

# Create Modelfile
cat > Modelfile << 'EOF'
FROM hito-1.7b-Q4_K_M.gguf
SYSTEM "You are Hito by Hitonet.com."
PARAMETER temperature 0.7
PARAMETER stop "<|im_end|>"
EOF

# Create and run
ollama create hito -f Modelfile
ollama run hito

llama.cpp

./llama-cli -m hito-1.7b-Q4_K_M.gguf \
  -sys "You are Hito by Hitonet.com." \
  -p "What is your name?" \
  -n 256

LM Studio

1. 1.Download any GGUF file from this repository
2. 2.Open LM Studio → Load Model
3. 3.Set system prompt: You are Hito by Hitonet.com.
4. 4.Start chatting!

Compatibility

These GGUF files work with:

• —Ollama (recommended)
• —llama.cpp
• —LM Studio
• —Jan
• —GPT4All
• —llama-cpp-python
• —Any llama.cpp-compatible application

What Makes Hito Special

• —Structured Thinking: Uses <think> tags for transparent reasoning
• —Self-Correcting: Catches errors mid-reasoning
• —Humble by Design: Admits uncertainty rather than hallucinating
• —Efficient: Only 1.7B parameters, runs on CPU

For full documentation, benchmarks, and training details, see the main repository.

Licensing

Model Weights (Apache 2.0)

The model weights are open source under Apache 2.0. You may use, modify, and distribute them freely.

Training Methodology (Commercial License Required)

The training methodology and cognitive framework used to create this model are proprietary to Hitonet.

Commercial use of the training methodology requires a license.

Attribution is mandatory when using this model or discussing its capabilities.

For commercial licensing inquiries: legal@hitonet.com

<div align="center"> <b>Made with genuine curiosity by Hitonet</b> </div>