Skip to content

Feat: Support LoRA and FP8 Adapter of Minimax-H3 and FastH3 - #44

Open
Uxito-Ada wants to merge 2 commits into
Tele-AI:mainfrom
Uxito-Ada:feat/minimax-h3-lora-adapters
Open

Feat: Support LoRA and FP8 Adapter of Minimax-H3 and FastH3#44
Uxito-Ada wants to merge 2 commits into
Tele-AI:mainfrom
Uxito-Ada:feat/minimax-h3-lora-adapters

Conversation

@Uxito-Ada

@Uxito-Ada Uxito-Ada commented Sep 2, 2026

Copy link
Copy Markdown
Collaborator

Summary

Enable Minimax-H3 LoRA adapter, and support the adapter to run with TeleFuser FP8 Linear

Supported adapter:

  • MiniMax-H3 Turbo LoRA
  • FastVideo fastvideo-lora-v2 to merge with dense FastH3, a FastVideo-finetuned H3

Adapter updates are merged into the BF16 base weights before optional FP8 conversion, so the FP8 quantizes the final adapted weights

Changes

  • Detect fastvideo-lora-v2 metadata and apply W += B @ A without an implicit alpha/rank scale
  • Stream and merge low-rank tensors plus exact .diff, .diff_b, and .diff_m residuals in float32
  • Expose --adapter-path / --lora-path and --adapter-strength through the standard MiniMax H3 FL2VA H100 example
  • Document BF16 adapter and FP8 Linear + adapter usage

Performance

Matched workload:

  • 1 * H100 80GB
  • 1344 x 768
  • 124 frames
  • 5.175 seconds
  • Minimax-H3 Turbo LoRA, and FastH3 adapter

Minimax-H3 Turbo LoRA, compared with the only one community solution on LightX2V:
minimax_h3_turbo_performance

Compared with LightX2V, TeleFuser improves denoising time by 26.7% and throughput by 36.5%.

FastH3 adapter, compared with FastVideo:
fasth3_performance

Compared with LightX2V, TeleFuser improves denoising time by 36.4% and throughput by 57.2%.

In addition, it is seen that FP8 does not shrink peak GPU memory so much, which is because that both LightX2V and FastVideo applies CPU offloading, whose whole weights size is actually double of the FP8 runtime. Their CPU offloading is at the cost of high latency.

Generated Output Comparison

All three outputs contain 124 H.264 frames at 1344 x 768 and synchronized stereo AAC audio.

minimax_h3_lora_adapter_quality
Adapter Framework Video
MiniMax-H3 Turbo LoRA LightX2V BF16 + Sol https://github.com/user-attachments/assets/aefb292d-bfa8-43d1-81f0-48b88892c4af
MiniMax-H3 Turbo LoRA TeleFuser FP8 + Sol https://github.com/user-attachments/assets/8bd84bf0-a3c6-45dd-a6f0-6d978aaa167d
FastH3 adapter FastVideo BF16 + FA4 https://github.com/user-attachments/assets/e63ab16b-d9ec-455c-8452-f206afcaeb17
FastH3 adapter TeleFuser FP8 + Sol https://github.com/user-attachments/assets/e441a17d-a6f9-47bd-abb5-a07eb5e33822

Testing

  • 149 passed: generic LoRA loader, MiniMax H3 model, pipeline, scheduler, parallelism, example, and adapter tests.
  • Added hybrid low-rank plus exact-delta merge coverage.
  • Added VSA replacement-gate rejection coverage.
  • Added adapter CLI forwarding and adapter-before-FP8 ordering coverage.
  • Ruff check and format check pass for all modified Python files.
  • git diff --check passes.
  • Verified the released dense-datafree safetensors header and tensor inventory with this branch.
  • Verified the three representative MP4s for codec, resolution, frame count, duration, and audio stream.

Add FastVideo fastvideo-lora-v2 mappings for low-rank updates and exact weight or bias deltas while preserving the released Turbo LoRA alpha contract.

Merge adapters into source weights before optional online FP8 conversion, reject unsupported VSA replacement gates, and expose adapter options through the standard FL2VA example.

Document BF16 and FP8 usage and cover hybrid merging, VSA rejection, CLI forwarding, and adapter-before-quantization ordering.
@Uxito-Ada Uxito-Ada changed the title feat(minimax-h3): support LoRA and FP8 adapters Feat: Support LoRA and FP8 adapter of Minimax-H3 Sep 2, 2026
@Uxito-Ada Uxito-Ada changed the title Feat: Support LoRA and FP8 adapter of Minimax-H3 Feat: Support LoRA and FP8 Adapter of Minimax-H3 Sep 2, 2026
@Uxito-Ada Uxito-Ada changed the title Feat: Support LoRA and FP8 Adapter of Minimax-H3 Feat: Support LoRA and FP8 Adapter of Minimax-H3 and FastH3 Sep 2, 2026
@Uxito-Ada
Uxito-Ada marked this pull request as draft September 2, 2026 02:35
@Uxito-Ada
Uxito-Ada marked this pull request as ready for review September 3, 2026 02:53
@Uxito-Ada
Uxito-Ada requested a review from lzx1413 September 3, 2026 02:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant