abliter8-ai/Roo-Voice_MOSS_TTS_LT_int8

Roo-Voice · MOSS-TTS-Local-Transformer · INT8 (bitsandbytes / CUDA)

Roo's voice — that signature baritone with the estuary accent that stands the hair up on the back of your neck — as an 8-bit checkpoint that runs on a modest NVIDIA GPU. Load it, and Roo can whisper to you all day long.

An INT8 (bitsandbytes) quantization of a full-model supervised fine-tune of MOSS-TTS-Local-Transformer, trained on Roo's own recordings and specialised on his single voice. This is the tighter-VRAM PC / NVIDIA-GPU form — for full precision use the BF16 build; for Apple Silicon use the MLX 8-bit build.

⚠️ What actually makes the voice — read first

This is a reference-conditioned model, and both halves matter:

• —The fine-tune is what makes it Roo. The base model has never heard this speaker — a base model plus any reference clip will not give you Roo's baritone or his estuary accent. That voice lives in the weights, put there by the supervised fine-tune on his recordings.
• —The reference completes the delivery. reference.wav (bundled) conditions the fine-tuned model at inference and is required to produce the voice.

So the product is this fine-tune + `reference.wav`, together — not a text-only model, and not a generic voice-cloner (swap the reference and it isn't Roo, because the accent and timbre are the fine-tune's, not the clip's).

What it is

Requirements

pip install "transformers==5.0.0" bitsandbytes accelerate torch soundfile

• —A CUDA NVIDIA GPU (bitsandbytes INT8 requires CUDA).
• —transformers==5.0.0 to match the model's remote code.
• —The quantization config is embedded — from_pretrained loads it in INT8 automatically. The backbone cache dimensions are mirrored onto the top-level config so generate() works out of the box.

Usage

This is a drop-in fine-tuned MossTTSLocal checkpoint. Run it via the standard MOSS-TTS Local inference path (PyTorch/CUDA) and pass reference.wav as the reference:

• —OpenMOSS MOSS-TTS reference pipeline — <https://github.com/OpenMOSS/MOSS-TTS>.
• —AutoProcessor + AutoModel (trust_remote_code=True) → build_user_message(text=..., reference=[...]) → model.generate(...) → processor.decode(...).

Decoding contract for this voice: seed 42, temperature 1.0, top-k 50, top-p 0.95, repetition penalty 1.1, 32 RVQ codebooks.

Limitations

• —Reference-conditioned — the bundled reference.wav must ride along; there is no text-only path.
• —Single voice by design (this is Roo, not a multi-speaker system).
• —INT8 backbone quantization: a small quality delta vs BF16/FP32 is possible; the sensitive heads and embeddings are kept fp16 to preserve timbre.

Provenance & license

Quantized/exported form of an accepted single-speaker MOSS-TTS Local supervised fine-tune. The base model and audio codec are Apache-2.0 (OpenMOSS); weights derived from them are redistributed here under the same license.