Repository navigation

add SP support for `flash_varlen_hub` backend - #13479

Merged

sayakpaul merged 26 commits into

huggingface:mainfrom

zhtmike:flash-attn-mask

May 9, 2026

Commits on Apr 15, 2026
- add mask support for flash backend
  zhtmike
  committed
  df8994d
- fix test case
  zhtmike
  committed
  2d12f46
Commits on Apr 16, 2026
- refactor test
  zhtmike
  committed
  003fa34
- add protection
  zhtmike
  committed
  bc61551
- fix comment
  zhtmike
  committed
  86fec43
- update according to suggestion
  zhtmike
  committed
  5034b2b
- revert change
  zhtmike
  committed
  e05bb28
Commits on Apr 17, 2026
- fix according to claude review
  zhtmike
  committed
  534fdc1
Commits on Apr 27, 2026
- Merge branch 'main' into flash-attn-mask
  zhtmike
  authored
  76414aa
- add test converage for QwenImage
  zhtmike
  committed
  1cd670b
Commits on May 4, 2026
- Merge origin/main into flash-attn-mask-dev
  zhtmike
  committed
  db7b8d4
- add SP support and fix non-contiguous mask for flash_varlen kernel
  zhtmike
  committed
  99e1660
- revert change
  zhtmike
  committed
  3d8cbf4
Commits on May 6, 2026
- Update tests/models/testing_utils/parallelism.py
  
  zhtmike
  and
  sayakpaul
  authored
  1b39db4
- Update tests/models/testing_utils/parallelism.py
  
  zhtmike
  and
  sayakpaul
  authored
  04a1bf5
- drop `_padded_to_unpad`
  zhtmike
  committed
  37a6db5
- follow `if _parallel_config is None` pattern
  zhtmike
  committed
  849062a
- Merge branch 'main' into flash-attn-mask
  zhtmike
  committed
  b042eb0
- Merge branch 'main' into flash-attn-mask
  sayakpaul
  authored
  611fc52
Commits on May 7, 2026
- rename `attn_mask_2d`
  zhtmike
  committed
  4c83820
- move check to the top
  zhtmike
  committed
  2823c24
- make comment clear
  zhtmike
  committed
  7335596
Commits on May 8, 2026
- move non-contiguous-attention-mask as default dummy data
  zhtmike
  committed
  90d08d4
- Merge branch 'main' into flash-attn-mask
  sayakpaul
  authored
  52bc7a3
- revert and update
  zhtmike
  committed
  8be05cd
- Merge branch 'main' into flash-attn-mask
  sayakpaul
  authored
  b024454