RichardErkhov/BigShort_-_krx_qwen2.5_7B_Instruct_it_v2.1-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

krxqwen2.57BInstructit_v2.1 - GGUF

• —Model creator: https://huggingface.co/BigShort/
• —Original model: https://huggingface.co/BigShort/krxqwen2.57BInstructit_v2.1/

Original model description: --- base_model: unsloth/qwen2.5-7b-instruct-bnb-4bit language:

• —en
• —ko license: apache-2.0 tags:
• —krx
• —text-generation-inference
• —transformers
• —unsloth
• —qwen2
• —trl datasets:
• —amphora/krx-sample-instructions
• —BCCard/BCCard-Finance-Kor-QnA
• —Cartinoe5930/rawtextsyntheticdataset50k
• —Cartinoe5930/webtextsyntheticdataset50k ---

Uploaded model

• —Developed by: BigShort
• —License: apache-2.0
• —Finetuned from model : unsloth/qwen2.5-7b-instruct-bnb-4bit

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>