CoolFace
Modelpublic

QuantFactory/Llama-3.2-3B-Agent007-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
3likes1.4kdownloads
Model Card

base_model: unsloth/llama-3.2-3b-instruct-bnb-4bit language:

  • en license: apache-2.0 tags:
  • text-generation-inference
  • transformers
  • unsloth
  • llama
  • trl

![QuantFactory Banner](https://hf.co/QuantFactory)

QuantFactory/Llama-3.2-3B-Agent007-GGUF

This is quantized version of EpistemeAI/Llama-3.2-3B-Agent007 created using llama.cpp

Original Model Card

Uploaded model

  • Developed by: EpistemeAI
  • License: apache-2.0
  • Finetuned from model : unsloth/llama-3.2-3b-instruct-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>