RichardErkhov/pantelis-ninja_-_unsloth-Qwen2.5-3B-Instruct_dtype-bfloat16_r-64_lr-0.0006-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

unsloth-Qwen2.5-3B-Instructdtype-bfloat16r-64_lr-0.0006 - GGUF

• —Model creator: https://huggingface.co/pantelis-ninja/
• —Original model: https://huggingface.co/pantelis-ninja/unsloth-Qwen2.5-3B-Instructdtype-bfloat16r-64_lr-0.0006/

Original model description: --- base_model: unsloth/qwen2.5-3b-instruct-bnb-4bit tags:

• —text-generation-inference
• —transformers
• —unsloth
• —qwen2
• —trl
• —sft license: apache-2.0 language:
• —en ---

Uploaded model

• —Developed by: pantelis-ninja
• —License: apache-2.0
• —Finetuned from model : unsloth/qwen2.5-3b-instruct-bnb-4bit

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>