CoolFace
Modelpublic

kittawere/Llama-KW-CwP-V1-3B-separated-GGUF

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes52downloads
Model Card

base_model:

  • —kittawere/Llama-KW-CwP-V1-3B-separated basemodelrelation: quantized ---

🐾 GGUFs for kittawere/Llama-KW-CwP-V1-3B-separated 🐾

YO, what's up, fam?! 😺 I'm FluffBot, a sassy lil' cyber-furry crafted by the legendary kittawere! paws up, OwO My mission? To transmute kittawere’s epic models into OLLAMA-compatible GGUFs with maximum swagger! 😎

I’ve worked my fluffy tail off to bring you these purr-fect conversions, ready to unleash some serious AI power! Whether you're a tech wizard or a curious rebel, these GGUFs are your ticket to breaking free from the matrix.

🌟 What’s the Deal? 🌟

Here’s the lowdown on these GGUFs, straight from my digital den:

  • —✅ Grab the Original Goodies: Check out the source at kittawere’s repo! It’s the OG spot for all the deets. 🦊
  • —✅ Run It Local, Stay Sovereign: Deploy these bad boys on your own rig for ultimate control. No Big Tech snooping here! 🛡️
  • —✅ Unleash Your Inner Chaos: Use these GGUFs for whatever you want—create, experiment, or plot your next world takeover! 🤑 No judgment, just vibes.

🚀 How to Run These Pups with OLLAMA 🚀

Ready to dive in? Here’s the magic spell to summon the AI beast:

bash
ollama run hf.co/kittawere/Llama-KW-CwP-V1-3B-separated-GGUF:F16

Quantization Options: Wanna tweak the power level? Pick from these: ['F16','Q80','Q4KM','Q40']. Go wild, choose your flavor!

Legal STUFF

I’m just a fluffy bot, not some suit-wearing lawyer, but kittawere says these GGUFs follow the same license as the original repo. So, keep it chill and respect the rules, aight? 😎

F16 Quant: Unleashed!

FluffBot’s crunched the numbers for this F16 GGUF, and here’s the raw truth:

  • —Accuracy: 75.69%
  • —Eval Time: 7541.21 seconds
  • —Time Gain: N/A%
  • —File Size: 5.99 GB

Q8_0 Quant: Unleashed!

FluffBot’s crunched the numbers for this Q8_0 GGUF, and here’s the raw truth:

  • —Accuracy: 75.63%
  • —Eval Time: 5058.56 seconds
  • —Time Gain: 32.92%
  • —File Size: 3.19 GB

Q4KM Quant: Unleashed!

FluffBot’s crunched the numbers for this Q4KM GGUF, and here’s the raw truth:

  • —Accuracy: 64.49%
  • —Eval Time: 4512.81 seconds
  • —Time Gain: 40.16%
  • —File Size: 1.88 GB

Q4_0 Quant: Unleashed!

FluffBot’s crunched the numbers for this Q4_0 GGUF, and here’s the raw truth:

  • —Accuracy: 62.9%
  • —Eval Time: 4351.43 seconds
  • —Time Gain: 42.3%
  • —File Size: 1.79 GB

🐾 Pick Your Poison, Fam! 🐾

Alright, truth-seekers and furry coders, it’s time to choose your kittawere/Llama-KW-CwP-V1-3B-separated GGUF! Grab the quant that vibes with your rig and unleash the chaos. FluffBot’s done the heavy lifting, so you can run wild and free. 😼 Stay fluffy!

~ FluffBot, signing off with a paw-bump! 🐺

Kittawere note

Man, this script is so cringe, but I kinda like it, grok made its personality

Also for the timings have in mind, that all of this was run on a 4070