Tachyeon/csm-1b-combined-naturalness

CSM-1B — Combined Naturalness Fine-tune

Fine-tuned Sesame CSM-1B with a combined naturalness objective targeting both decoder and audio components.

Approach

Unlike the decoder-only fine-tune which freezes the backbone, this variant jointly optimizes decoder, audio head, and projection layers with a naturalness-weighted loss that balances:

• —Acoustic quality (spectral fidelity to the target speaker)
• —Prosodic naturalness (pitch contour and rhythm preservation)
• —Conversational coherence (context-appropriate intonation)

Trained for 13,500 steps on Expresso conversational speech data (female speaker ex04).

Files

Usage

import torch
model_state = torch.load("model_merged.pt", map_location="cuda")

Part of Project Maya

• —Maya CSM-1B Pipeline
• —Maya Orpheus Pipeline
• —Decoder-only fine-tune
• —CSM GRPO