CoolFace
Modelpublic

cstr/granite-speech-3.3-2b-GGUF

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face
0likes154downloads
Model Card

granite-speech-3.3-2b-GGUF

GGUF quantisations of ibm-granite/granite-speech-3.3-2b for CrispASR.

QuantDescription
F16Full precision
Q8_08-bit
Q5_05-bit
Q4_K4-bit K-quant (recommended)

Usage

bash
crispasr -m granite-speech-3.3-2b-q4_k.gguf -f audio.wav

Provenance and EU AI Act Art. 53 note

  • Upstream model: ibm-granite/granite-speech-3.3-2b — published by ibm-granite.
  • Upstream licence: apache-2.0. This repository redistributes under the same terms; it grants no rights the upstream licence does not.
  • What was done here: format conversion and/or quantisation only (GGUF). No training, no fine-tuning, no merging, no distillation, no change to architecture, vocabulary or capability. Only the numeric representation of the upstream weights differs.
  • Training data: documented — where it is documented at all — by the upstream provider; see the upstream model card. No training data was used, added or selected by this repository.
  • Provider status: under Regulation (EU) 2024/1689 the upstream authors remain the provider of this model. Converting the serialisation format does not make this repository the provider of a new general-purpose AI model, and no such claim is made. Questions about training content, copyright policy or model capability belong upstream.