Skip to content

test: add Qwen3 multiprocess regression cases - #250

Merged
kilinchange merged 1 commit into
masterfrom
test/qwen3-multiprocess-cases
Oct 20, 2026
Merged

kilinchange merged 1 commit into
masterfrom
test/qwen3-multiprocess-cases

Conversation

@JYMiracle305

Copy link
Copy Markdown
Contributor

修改内容

  • 为 Qwen3 新增 8 进程端到端训练用例,覆盖 TP、PP、SP、LoRA 和 3D 并行场景。
  • 每个进程使用 1 个训练线程,通过 infini_run --nproc_per_node=8 启动。
  • compare_loss.py 同时兼容 _bfloat16 和 _bf16 后缀,确保 BF16 用例使用正确的 loss 比较阈值。

@JYMiracle305

Copy link
Copy Markdown
Contributor Author

精度对比

image

性能对比

image

@kilinchange
kilinchange merged commit b42864a into master Oct 20, 2026
3 checks passed
@kilinchange
kilinchange deleted the test/qwen3-multiprocess-cases branch October 20, 2026 09:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants