srt1902/smollm2-xsum-grpo-lora
07
Uploaded finetuned model
- Developed by: srt1902
- License: apache-2.0
- Finetuned from model : unsloth/SmolLM2-135M-Instruct-bnb-4bit
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.