Feat: Support LoRA and FP8 Adapter of Minimax-H3 and FastH3 - #44
Open
Uxito-Ada wants to merge 2 commits into
Open
Feat: Support LoRA and FP8 Adapter of Minimax-H3 and FastH3#44Uxito-Ada wants to merge 2 commits into
Uxito-Ada wants to merge 2 commits into
Conversation
Add FastVideo fastvideo-lora-v2 mappings for low-rank updates and exact weight or bias deltas while preserving the released Turbo LoRA alpha contract. Merge adapters into source weights before optional online FP8 conversion, reject unsupported VSA replacement gates, and expose adapter options through the standard FL2VA example. Document BF16 and FP8 usage and cover hybrid merging, VSA rejection, CLI forwarding, and adapter-before-quantization ordering.
Uxito-Ada
marked this pull request as draft
September 2, 2026 02:35
Uxito-Ada
marked this pull request as ready for review
September 3, 2026 02:53
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Enable Minimax-H3 LoRA adapter, and support the adapter to run with TeleFuser FP8 Linear
Supported adapter:
fastvideo-lora-v2to merge with dense FastH3, a FastVideo-finetuned H3Adapter updates are merged into the BF16 base weights before optional FP8 conversion, so the FP8 quantizes the final adapted weights
Changes
fastvideo-lora-v2metadata and applyW += B @ Awithout an implicit alpha/rank scale.diff,.diff_b, and.diff_mresiduals in float32--adapter-path/--lora-pathand--adapter-strengththrough the standard MiniMax H3 FL2VA H100 examplePerformance
Matched workload:
Minimax-H3 Turbo LoRA, compared with the only one community solution on LightX2V:

Compared with LightX2V, TeleFuser improves denoising time by 26.7% and throughput by 36.5%.
FastH3 adapter, compared with FastVideo:

Compared with LightX2V, TeleFuser improves denoising time by 36.4% and throughput by 57.2%.
In addition, it is seen that FP8 does not shrink peak GPU memory so much, which is because that both LightX2V and FastVideo applies CPU offloading, whose whole weights size is actually double of the FP8 runtime. Their CPU offloading is at the cost of high latency.
Generated Output Comparison
All three outputs contain 124 H.264 frames at 1344 x 768 and synchronized stereo AAC audio.
Testing
149 passed: generic LoRA loader, MiniMax H3 model, pipeline, scheduler, parallelism, example, and adapter tests.git diff --checkpasses.dense-datafreesafetensors header and tensor inventory with this branch.