retronic/Colox_The1st-LORA_GGUF

What is this?

This is the Colox-v1 GGUF Lora adapter.

How can I use this?

This is compatible with any service that supports GGUF Lora adpaters plus base model. (ex: llama-cpp, ollama, etc.)

What is the base model?

Llama 3.1 8B Instruct

How is this Lora adapter quanitized?

This has been quanitized to F16.