Repository navigation

[feat] Tensor parallelism for MiniMax-H3 - #14609

Open

JingyaHuang wants to merge 8 commits into

huggingface:mainfrom

JingyaHuang:add-h3-tp-support

Commits on Oct 8, 2026

Add tensor-parallel support for MiniMax-H3
JingyaHuang
committed
00352eb
Shard MiniMax-H3's adaln_proj to fit tensor parallelism on one device

JingyaHuang
and
claude
committed
f87db53
Build MiniMax-H3's row timestep plan on CPU, as its caller expects

JingyaHuang
and
claude
committed
12ebc64
feat:combine tp+cp
JingyaHuang
committed
cbd798d
Allow tensor parallelism and context parallelism in one ParallelConfig

authored and
JingyaHuang
committed
fc1fa93
feat: validate the support on TPU
JingyaHuang
committed
55a806f
fix: put tp first in the combined TP+CP mesh
JingyaHuang
committed
e4ae9de
fix: style
JingyaHuang
committed
3e2576f