Skip to content

[V100/SM70] FastDeploy V100 support: custom CUDA kernels, prefill attention, and runtime bugfixes - #6306

Open
mattheliu wants to merge 54 commits into
PaddlePaddle:developfrom
mattheliu:fastdeploy_v100
Open

mattheliu wants to merge 54 commits into
PaddlePaddle:developfrom
mattheliu:fastdeploy_v100

[V100] Restore try-except ImportError guard in append_attention.py

03b4fb9
Select commit
Loading
Failed to load commit list.
Sign in for the full log view