Modelpublic

siyah1/EchoMimicV3-NF4

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face

0likes

Model Card

EchoMimicV3 — NF4 Quantized

This is a NF4 (NormalFloat4) quantized version of EchoMimicV3.

Quantization Details

Parameter	Value
Quantization Type	NF4 (NormalFloat4)
Double Quantization	Yes
Compute Dtype	float16
Library	bitsandbytes
VRAM Reduction	~65% (5 GB → ~1.7 GB)

Usage

python

from transformers import BitsAndBytesConfig
import torch

nf4_config = BitsAndBytesConfig(
    load_in_4bit=True,
    bnb_4bit_quant_type="nf4",
    bnb_4bit_use_double_quant=True,
    bnb_4bit_compute_dtype=torch.float16
)