Modelpublic

bombman/Nucleus-Image-FP8-Native

sourceHugging Facecreativeml-openrail-mupdated 5mo agoView on Hugging Face

0likes5downloads

Model Card

Nucleus-Image-FP8-Native

This is a native FP8 (float8_e4m3fn) quantization of the 17B Nucleus-Image model.

This model is EXTREMELY HEAVY. Even in FP8, the weights alone take up ~13-14GB of VRAM.

—16GB VRAM (RTX 4060 Ti / 4070 Ti Super / 4080): Recommended to use with sequential_cpu_offload for stability. Pure GPU inference might OOM at 1024x1024.
—24GB VRAM (RTX 3090 / 4090): Best experience. Can run Pure GPU without offloading.
—12GB VRAM or less: NOT RECOMMENDED unless using heavy CPU offloading (will be slow).