RichardErkhov/Merdeka-LLM_-_merdeka-llm-lawyer-3b-128k-instruct-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

merdeka-llm-lawyer-3b-128k-instruct - GGUF

• —Model creator: https://huggingface.co/Merdeka-LLM/
• —Original model: https://huggingface.co/Merdeka-LLM/merdeka-llm-lawyer-3b-128k-instruct/

Original model description: --- base_model: unsloth/Llama-3.2-3B-Instruct language:

• —en license: apache-2.0 tags:
• —text-generation-inference
• —transformers
• —unsloth
• —llama
• —trl ---

Uploaded model

• —Developed by: Merdeka-LLM
• —License: apache-2.0
• —Finetuned from model : unsloth/Llama-3.2-3B-Instruct

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>

Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more quants, at much higher speed, than I would otherwise be able to.