CoolFace
Modelpublic

TheDrummer/Endurance-100B-v1-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
4likes631downloads
Model Card

Join our Discord! https://discord.gg/Nbv9pQ88Xb

2500+ members strong 💪 Now with more channels! A hub for users and makers alike!

Endurance 100B v1 🎡

A finetune of [Lazarus 2407 100B](https://huggingface.co/TheDrummer/Lazarus-2407-100B), a pruned Mistral Large 2407 123B!

image/png

Do not go gentle into that good night. Rage, rage against the dying of the light!

Links

  • —Original: https://huggingface.co/TheDrummer/Endurance-100B-v1
  • —GGUF: https://huggingface.co/TheDrummer/Endurance-100B-v1-GGUF
  • —iMatrix: https://huggingface.co/bartowski/Endurance-100B-v1-GGUF (recommended for smaller quants)

Arsenal (Supported Chat Templates)

  • —Metharme (Pygmalion in ST)
  • —Creative, unhinged, unique

Favorite RP Format

*action* Dialogue *thoughts* Dialogue *narration* in 1st person PoV

Favorite Card

image/png Audrey by thecooler

Comparisons

QuantExperience123B100B72B
IQ2_XXSFunctional32.43GB26.61GB25.49GB
IQ3_XXSAcceptable47.01GB38.54GB31.85GB
IQ4_XSGood65.43GB53.64GB39.71GB

Technical Details

Refer to [Lazarus 2407 100B](https://huggingface.co/TheDrummer/Lazarus-2407-100B) for pruning details.

Endurance used the same hyperparameters as Behemoth. Training loss indicates that they are exactly the same albeit with lower confidence.

image/png

Notes on Lazarus 100B (base model for Endurance):

  • —Testers have noted that 100B seemed nearly identical to 123B.
  • —One tester said that only one minor mistake was made by the model, requiring a rewrite for failing to pick up on the nuance.
  • —Another tester went through a satisfying 32K playthrough without any issues.

Endurance 100B v1.0 has gone through additional RP & Instruct training.