Image-to-Video
Diffusers
text-to-video
image-text-to-video
video-to-video
text-to-audio-video
image-to-audio-video
image-text-to-audio-video
video-to-audio-video
audio-to-audio-video
audio-video-generation
multimodal
synchronized-audio-video
reference-to-audio-video
Instructions to use rzgar/minimax_h3_ref2va_fp8_e4m3fn with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use rzgar/minimax_h3_ref2va_fp8_e4m3fn with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("rzgar/minimax_h3_ref2va_fp8_e4m3fn", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
MiniMax H3 Ref2VA (mxfp8 & fp16attn_fp8)
Quantized versions of the MiniMax H3 Ref2VA (reference-to-video-audio)
diffusion model. Both keep the text-conditioning path (token_refiner,
conditioning projections, audio heads) in full precision.
Latest comfy version improves audio quality at low steps.
minimal 5 step (talking heads, less motions) | balanced 8-steps (shift 8) | Action-rich scenes above 12 (shift max 12)
| File | Download | Note |
|---|---|---|
minimax_h3_ref2va_fp16attn_fp8.safetensors |
Download 28.7GB | FP16 attention + FP8-E4M3 MLP |
minimax_h3_ref2va_mxfp8.safetensors |
Download 47.6GB | E4M3 weights, E8M0 block scales |
Comparison
| fp16attn_fp8 | mxfp8 | |
|---|---|---|
| Size | 28.7 GB | 47.6 GB |
| Base checkpoint | pruned fp8_scaled (curve-form, adaln_t_table) |
full bf16 (time-embedder) |
| Attention (qkv/out) | FP16 (exact) | MXFP8 (block-quantized) |
| MLP (fc1/fc2) | FP8-E4M3 per-tensor absmax | MXFP8 block-quantized |
| Quant scale granularity | per-tensor | per-32 block (better outlier handling) |
input_scale |
calibrated (fc1), fpmm on fc2 | 1.0 identity (150 layers) |
| token_refiner / conditioning | full precision | full precision |
| Relative precision | higher than pruned fp8, attn lossless | highest of the two (finer scales) |
| Memory footprint | lighter (faster load, less streaming) | heavier |
| Best for | everyday use / speed-first setups | maximum quality per weight bit |
- Downloads last month
- 96
Model tree for rzgar/minimax_h3_ref2va_fp8_e4m3fn
Base model
MiniMaxAI/MiniMax-H3