[V0.9.1] Replace FA interface with FA_V2 to optimize perf in SelfAttention#1701
Open
rjg-lyh wants to merge 1 commit intovllm-project:v0.9.1-devfrom
Open
[V0.9.1] Replace FA interface with FA_V2 to optimize perf in SelfAttention#1701rjg-lyh wants to merge 1 commit intovllm-project:v0.9.1-devfrom
rjg-lyh wants to merge 1 commit intovllm-project:v0.9.1-devfrom
