RichardErkhov/richie-ghost_-_unsloth-Yi-1-5-9B-Chat-quantized_merge_4Bit-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

unsloth-Yi-1-5-9B-Chat-quantizedmerge4Bit - GGUF

• —Model creator: https://huggingface.co/richie-ghost/
• —Original model: https://huggingface.co/richie-ghost/unsloth-Yi-1-5-9B-Chat-quantizedmerge4Bit/

Original model description: --- language:

• —en license: apache-2.0 tags:
• —text-generation-inference
• —transformers
• —unsloth
• —llama
• —trl
• —sft base_model: 01-ai/Yi-1.5-9B-Chat ---

Uploaded model

• —Developed by: richie-ghost
• —License: apache-2.0
• —Finetuned from model : 01-ai/Yi-1.5-9B-Chat

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>