[Core] fix QKV fusion for attention - #8829

Merged

sayakpaul merged 19 commits into

mainfrom

Jul 24, 2024

Commits on Jul 10, 2024

start debugging the problem,
sayakpaul
committed
3dceb84
start
sayakpaul
committed
a352a67
fix
sayakpaul
committed
77ab545
fix
sayakpaul
committed
2ee335f
fix imports.
sayakpaul
committed
ddcc102
handle hunyuan
sayakpaul
committed
8f46177
remove residuals.
sayakpaul
committed
ee39007

Commits on Jul 11, 2024

Merge branch 'main' into fix-qkv-fusion
sayakpaul
authored
a774721
add a check for making sure there's appropriate procs.
sayakpaul
committed
be3adcf

Commits on Jul 18, 2024

Merge branch 'main' into fix-qkv-fusion
sayakpaul
authored
991cc56
Merge branch 'main' into fix-qkv-fusion
sayakpaul
authored
1575973
add more rigor to the tests.
sayakpaul
committed
eb94d4f
fix test
sayakpaul
committed
ce67fe8

Commits on Jul 19, 2024

remove redundant check
sayakpaul
committed
d563b9e
fix-copies
sayakpaul
committed
8214c88

Commits on Jul 20, 2024

Commits on Jul 23, 2024

Merge branch 'main' into fix-qkv-fusion
sayakpaul
authored
e4b14db
Merge branch 'main' into fix-qkv-fusion
sayakpaul
authored
8fa4a09