abakanai/Minimax_h3_hybrid

MiniMax H3 Hybrid NVFP4 for NVIDIA Blackwell

Two experimental mixed-precision quantizations of the MiniMax H3 Ref2VA Pruned diffusion model, optimized and tested locally on an NVIDIA GeForce RTX 5070 Ti 16 GB (Blackwell, SM 12.0).

This is an independent community optimization by abakanai. It is not an official MiniMax or ComfyUI release. The checkpoints are inference-only single-file diffusion weights for ComfyUI; they are not LoRAs and do not include the text encoder or VAEs.

Checkpoints

The attention-output and FFN-output projections remain INT8 ConvRot in both variants. This preserves the fused SwiGLU path and avoids spending precision where native NVFP4 did not provide a measured speed benefit.

Generated examples

All media below are AI-generated. The paired videos in each comparison use the same reference image, prompt, seed, resolution, duration, sampler, scheduler, and step count.

<Gallery />

Matched-seed comparison

[image]

• —Conservative hybrid video with audio
• —Fast hybrid video with audio

A/B generation settings

<details> <summary>Prompt used for both videos</summary>

<Picture 1> The same young adult anime woman looks into the camera, blinks naturally, smiles, then slowly forms a heart with both hands in front of her chest. Her short black hair moves gently. Smooth expressive character animation, stable face and round glasses, consistent fingers and hands, clean pink-and-white background, locked camera, no scene cuts. No speech.

</details>

In this single-seed qualitative check, both variants preserved the character's face and glasses across the clip. The conservative variant held finger shapes slightly more consistently, while the fast variant produced a very similar result with somewhat larger changes in background composition and framing. This is one visual sample, not a statistically meaningful perceptual evaluation.

1376 × 768 simple follow-up

The two hybrid checkpoints were also tested at 1376 × 768 using the same reference, prompt, seed, 124-frame duration, 20 steps, and res_multistep sampler. The scheduler was changed to simple for both matched runs.

• —Fast 14.03 GiB high-resolution video with audio
• —Conservative 16.38 GiB high-resolution video with audio

Both runs completed on the RTX 5070 Ti 16 GB through ComfyUI DynamicVRAM and produced 124-frame, 24 fps MP4 files with stereo AAC audio at 32 kHz. The fast checkpoint finished about 5% sooner in these sequential single runs. This is a practical observation rather than a controlled end-to-end benchmark because model and cache state were not fully reset between jobs.

Research summary

Test environment

• —NVIDIA GeForce RTX 5070 Ti, 16 GB
• —Blackwell, SM 12.0
• —PyTorch 2.10.0+cu130
• —CUDA 13.0
• —comfy-kitchen 0.2.26
• —BF16 compute
• —Baseline: minimax_h3_ref2va_pruned_int8_convrot.safetensors, 19.53 GiB

Attention and INT8 baseline

ComfyUI already dispatched MiniMax H3 full attention to cuDNN SDPA. At a sequence length of 16,384 tokens, one attention call took approximately 88 ms. Changing SDPA backend priority and forcing contiguous Q/K/V layouts did not produce a stable improvement.

The original INT8 ConvRot checkpoint already used a fused CUTLASS kernel. Forcing the cuBLAS fallback was 15–30% slower depending on matrix shape, so the CUTLASS path was retained.

Native NVFP4 projection benchmarks

Measurements below use a sequence length of 16,000 tokens and report one projection call from one H3 block.

A full conversion of every linear layer to NVFP4 was not selected. The FFN output projection did not become faster, while numerical error accumulated more strongly across the model's 50 blocks, especially in the audio channel.

For the fast hybrid, the combined time of these four major linear operations decreased from approximately 43.5 ms to 30.4 ms per block, a reduction of about 30%. Full-attention complexity remains the principal high-resolution bottleneck.

50-block numerical smoke test

Each candidate was compared with a freshly executed INT8 baseline on identical input tensors.

No NaN or Inf values were observed. These cosine measurements describe numerical similarity for a controlled smoke test; they do not replace full iterative visual and audio evaluation.

ComfyUI usage

Place one checkpoint in:

ComfyUI/models/diffusion_models/

The Ref2VA workflow also requires the companion files from `Comfy-Org/MiniMax-H3`:

ComfyUI/models/text_encoders/qwen3vl_32b_minimax_h3_nvfp4_awq.safetensors
ComfyUI/models/vae/minimax_h3_video_vae_fp16.safetensors
ComfyUI/models/vae/minimax_h3_audio_vae_fp32.safetensors

In ComfyUI:

1. 1.Load one of the checkpoints with UNETLoader and leave weight_dtype at default.
2. 2.Use the standard MiniMax H3 reference-to-video conditioning path.
3. 3.Keep the ComfyUI-selected PyTorch attention backend; on the tested setup this resolved to cuDNN SDPA.
4. 4.Use ref_image_size=match when maximum reference-token detail is not required, particularly on 16 GB cards.
5. 5.Do not force the INT8 cuBLAS fallback on the tested Blackwell configuration.

The checkpoints rely on native NVFP4 operations exposed by a recent ComfyUI/comfy-kitchen build. They are intended for NVIDIA Blackwell GPUs, including GeForce RTX 50-series cards. Compatibility and performance on pre-Blackwell NVIDIA GPUs, ROCm, MPS, DirectML, XPU, NPU, and other backends have not been validated.

Limitations

• —Tested on one RTX 5070 Ti configuration; results should not be generalized to every RTX 50-series GPU without measurement.
• —MiniMax H3 uses full attention in the evaluated open implementation. NVFP4 linear-projection gains do not remove the quadratic attention cost at high token counts.
• —The fast variant has lower numerical similarity, especially in the audio channel. Prefer the conservative checkpoint when fidelity matters more than model size.
• —The A/B media represents one seed and one reference image. More prompts, motion patterns, identities, durations, and audio scenarios are needed for a broader quality evaluation.
• —These checkpoints are experimental community conversions and are provided without warranty.

License and use restrictions

The MiniMax H3 diffusion weights and derivatives are governed by the [MiniMax H3 Community License Agreement](https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE), not Apache-2.0. The license contains territorial restrictions, an Acceptable Use Policy, redistribution requirements, and additional commercial terms. In particular, the defined applicable territory excludes the European Union, the United Kingdom, the Republic of Korea, and the United States of America. Read the full `LICENSE` and `NOTICE` before downloading, using, or redistributing these files.

The separately distributed Qwen3-VL-32B encoder is licensed under Apache-2.0 by its respective authors.

Acknowledgements

• —Original model: `MiniMaxAI/MiniMax-H3`
• —ComfyUI single-file release and integration: `Comfy-Org/MiniMax-H3`
• —Hybrid quantization, kernel benchmarking, numerical validation, and A/B generation: abakanai