feizhai123/MiniMax-H3-ModelOpt-Mixed9-Dynamic-FP8

MiniMax-H3 ModelOpt Mixed Dynamic FP8

This repository contains mixed BF16/FP8 derivatives of both MiniMax-H3 video generation partitions:

• —FL2VA, under FL2VA/, supports T2VA/FL2VA and targets an effective precision of 9.0 bits.
• —Ref2VA, under Ref2VA/, supports reference-conditioned video and audio generation and targets an effective transformer precision of 9.25 bits.

The checkpoints target single-GPU vLLM-Omni serving. CPU component offload is recommended on GPUs that cannot hold all resident components.

License: these derivatives remain subject to the MiniMax H3 Community License Agreement in LICENSE, including its territorial, redistribution, notice, and acceptable-use requirements. Review that license before using or redistributing this model.

Runtime format

“Mixed9” and “Mixed9.25” are parameter-weighted effective precisions. They do not denote scalar 9-bit dtypes.

FL2VA Mixed9

The FL2VA/ checkpoint was selected using BF16-vs-dynamic-FP8 relative MSE.

FL2VA transformer scope

Kept in BF16:

• —proj_in, audio_proj_in, context_embedder, both timestep embedding linears, proj_out, and audio_proj_out.
• —Attention output projections in transformer blocks 29-48.
• —FFN input/gate-up projections in blocks 28, 31, 32, 33, 41, 45, and 46.
• —FFN output projections in blocks 5, 6, 8-10, 12-14, 19, 20, and 30-48.
• —Biases, normalization parameters, RoPE buffers, and other non-linear state.

Quantized to dynamic FP8:

• —All Q/K/V projections and AdaLN linears in transformer blocks 0-49.
• —All Linear projections in both token-refiner blocks and norm_out.linear.
• —Attention and FFN projections not listed in the BF16 sets above.

Shared Qwen3-VL text encoder scope

Kept in BF16:

• —Token embeddings, RMSNorms, rotary state, all non-linear parameters, and the complete Qwen3-VL vision encoder.
• —Attention o_proj in language layers 24, 25, 30, 31, 35, 37, 38, 40, and 42-49.
• —MLP down_proj in language layers 17-19, 21-30, 34, 36, 46, 48, and 49.

Quantized to dynamic FP8:

• —All Q/K/V and MLP gate/up projections in language layers 0-49.
• —Every attention o_proj and MLP down_proj not listed above.

The video VAE, audio VAE, tokenizer, processor, embeddings, normalization layers, and vision encoder remain unquantized.

Exact selections and sensitivity scores are stored in:

• —FL2VA/transformer/transformer_mixed_precision_config.json
• —FL2VA/transformer/transformer_sensitivity_ranking.tsv
• —FL2VA/text_encoder/text_encoder_mixed_precision_config.json
• —FL2VA/text_encoder/text_encoder_sensitivity_ranking.tsv

Ref2VA GlobalGrad Mixed9.25

The Ref2VA transformer was independently selected from BF16 using an output-probed global-gradient sensitivity score. This is a custom search inspired by mixed-precision AutoQuant; it is not an NVIDIA ModelOpt AutoQuant export. ModelOpt performs the dynamic FP8 conversion and export.

Ref2VA transformer scope

Also quantized to dynamic FP8:

• —All Q/K/V, attention-output, and FFN Linear projections in both token-refiner blocks.
• —norm_out.linear.

Always retained in BF16:

• —context_embedder, proj_in, audio_proj_in, both timestep embedding linears, proj_out, and audio_proj_out.
• —Biases, normalization parameters, RoPE buffers, and all other non-linear state.

Ref2VA reuses the Mixed9 Qwen3-VL text encoder described above. Its VAEs, tokenizer, processor, embeddings, normalization layers, and vision encoder are not quantized. The exact transformer decisions are stored in:

• —Ref2VA/transformer/transformer_mixed_precision_config.json
• —Ref2VA/transformer/transformer_sensitivity_ranking.tsv

Similarity samples

These are deterministic short regression samples, not comprehensive perceptual-quality benchmarks.

For the Ref2VA sample, FP8 peak GPU memory was 84,842 MiB versus 131,308 MiB for BF16, saving 46,466 MiB (35.39%). The request used the same extracted reference frame/audio and saved BF16 baseline, produced 107 frames, and used a 4-second requested duration. Full machine-readable results are included in:

• —evaluation/t2va_bf16_similarity.json
• —evaluation/ref2va_globalgrad9p25_bf16_similarity.json

vLLM-Omni serving

This checkpoint requires vLLM-Omni with MiniMax-H3 ModelOpt mixed-FP8 loading support.

FL2VA/T2VA:

~~~bash CUDAVISIBLEDEVICES=0 \ vllm-omni serve feizhai123/MiniMax-H3-ModelOpt-Mixed9-Dynamic-FP8 \ --omni \ --host 0.0.0.0 \ --port 8000 \ --trust-remote-code \ --task-type t2va \ --enforce-eager \ --force-cutlass-fp8 \ --enable-cpu-offload \ --stage-init-timeout 1800 \ --init-timeout 2400 ~~~

Ref2VA:

~~~bash hf download feizhai123/MiniMax-H3-ModelOpt-Mixed9-Dynamic-FP8 \ --local-dir ./MiniMax-H3-ModelOpt-Mixed9-Dynamic-FP8

CUDAVISIBLEDEVICES=0 \ vllm-omni serve ./MiniMax-H3-ModelOpt-Mixed9-Dynamic-FP8/Ref2VA \ --omni \ --host 0.0.0.0 \ --port 8000 \ --trust-remote-code \ --enforce-eager \ --force-cutlass-fp8 \ --enable-cpu-offload \ --stage-init-timeout 1800 \ --init-timeout 2400 ~~~

Modification notice

Selected H3 transformer and Qwen3-VL language-model Linear weights were modified from the original MiniMax-H3 checkpoints by mixed BF16/FP8 quantization. The VAEs, Qwen3-VL vision encoder, tokenizer, processor, and other explicitly retained parameters remain in their original precision.