CoolFace
Modelpublic

ghostai1/Chrismas-Spirit7b

sourceHugging Facemitupdated 8mo agoView on Hugging Face
1likes127downloads
Model Card

<!-- GHOSTAI • CHRISTMAS SPIRIT GGUF (7B) Professional Hugging Face README for a GGUF release. -->

<p align="center"> <img src="https://capsule-render.vercel.app/api?type=waving&color=0:0b1d12,50:8b0000,100:0b1d12&height=170&section=header&text=GHOSTAI%20%E2%80%94%20CHRISTMAS%20SPIRIT%20GGUF%20(7B)&fontSize=40&fontColor=F7F7F7&animation=twinkling" /> </p>

<p align="center"> <img alt="Format" src="https://img.shields.io/badge/Format-GGUF-0B1D12?style=for-the-badge"> <img alt="Runtime" src="https://img.shields.io/badge/Runtime-llama.cpp-14532D?style=for-the-badge"> <img alt="Model Size" src="https://img.shields.io/badge/Model-7B-1F6FEB?style=for-the-badge"> <img alt="Theme" src="https://img.shields.io/badge/Theme-Christmas%20Spirit-8B0000?style=for-the-badge"> <a href="https://www.linkedin.com/in/ccengineering/"> <img alt="LinkedIn" src="https://img.shields.io/badge/LinkedIn-ccengineering-0A66C2?style=for-the-badge&logo=linkedin&logoColor=white"> </a> </p>

<p align="center"> <strong>GHOSTAI — Christmas Spirit GGUF (7B)</strong><br/> A holiday-forward 7B model tuned for cozy storytelling, cheerful roleplay, and warm seasonal vibes — shipped in <strong>GGUF</strong> for the <strong>llama.cpp</strong> ecosystem.<br/> <sub>Quantized builds included for most users. An optional F16 GGUF is included for maximum fidelity.</sub> </p>

Overview

GHOSTAI: Christmas Spirit is designed to produce cozy, wholesome, and festive outputs: winter scenes, gift-giving stories, cheerful dialog, holiday recipes, and family-friendly roleplay.

This repository provides multiple GGUF variants, so you can choose the best balance of quality, speed, and memory usage for your hardware.

You can run it:

  • —CPU-only
  • —With GPU offload (CUDA / Metal / Vulkan builds of llama.cpp)

Quant choice is independent of CPU vs GPU; GPU offload is controlled by runtime flags (example: -ngl).

Files (this release)

Sizes below reflect the exported files in this repo.

FileQuantApprox sizeRough RAM needed (4k ctx)
christmas_mistral_v1.f16.gguff16~13.5 GB~16–18 GB
christmas_mistral_v1.Q8_0.ggufQ8_0~7.2 GB~10–11 GB
christmas_mistral_v1.Q6_K.ggufQ6_K~5.5 GB~8–9 GB
christmas_mistral_v1.Q5_K_M.ggufQ5KM~4.8 GB~7–8 GB
christmas_mistral_v1.Q5_K_S.ggufQ5KS~4.7 GB~7–8 GB
christmas_mistral_v1.Q4_K_M.ggufQ4KM~4.1 GB~6–7 GB
christmas_mistral_v1.Q4_K_S.ggufQ4KS~3.9 GB~6–7 GB
christmas_mistral_v1.Q3_K_M.ggufQ3KM~3.3 GB~5–6 GB
christmas_mistral_v1.Q3_K_S.ggufQ3KS~3.0 GB~5–6 GB
christmas_mistral_v1.Q2_K.ggufQ2_K~2.5 GB~4–5 GB
christmas_mistral_v1.TQ1_0.ggufTQ1_0~1.6 GB~3–4 GB

RAM notes (rough):

  • —Assumes ~4k context and typical llama.cpp overhead.
  • —For 8k context, plan +1–2 GB extra (or more depending on runner/settings).
  • —GPU offload can shift some load to VRAM; you still need system RAM.

Recommended downloads

  • —Best default: `christmas_mistral_v1.Q4_K_M.gguf`
  • —Higher quality: `Q5_K_M`, `Q6_K`, `Q8_0`
  • —Low RAM: `Q3_K_S`, `Q2_K`
  • —Ultra-small / experimental: `TQ1_0` (expect noticeable quality loss)
  • —Maximum fidelity: `f16` (largest)

Quickstart (llama.cpp)

CPU-only (simple + portable)

bash
./llama-cli \
  -m christmas_mistral_v1.Q4_K_M.gguf \
  -ngl 0 \
  -c 4096 \
  -p "You are GHOSTAI Christmas Spirit. Write a cozy winter story set in a small town, with a warm ending."