Modelpublic

vinhnx90/vt-qwen-3b-GRPO-merged-16bit-bnb-4bit

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face

0likes9downloads

Model Card

vinhnx90/vt-qwen-3b-GRPO-merged-16bit (Quantized)

Description

This model is a quantized version of the original model `vinhnx90/vt-qwen-3b-GRPO-merged-16bit`.

It's quantized using the BitsAndBytes library to 4-bit using the bnb-my-repo space.

Quantization Details

—Quantization Type: int4
—bnb_4bit_quant_type: fp4
—bnb_4bit_use_double_quant: True
—bnb_4bit_compute_dtype: bfloat16
—bnb_4bit_quant_storage: bfloat16

📄 Original Model Information

Uploaded model

—Developed by: vinhnx90
—License: apache-2.0
—Finetuned from model : unsloth/qwen2.5-3b-instruct-unsloth-bnb-4bit

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>