Skip to content
format / pr body

[bugfix][torchair] fix wasted NPU memory buffer allocation for quantized deepseek with unquantized MTP layer #5995

Sign in to view logs

[bugfix][torchair] fix wasted NPU memory buffer allocation for quantized deepseek with unquantized MTP layer

[bugfix][torchair] fix wasted NPU memory buffer allocation for quantized deepseek with unquantized MTP layer #5995

Run time

Learn about OS pricing on GitHub Actions
Job Run time
update vLLM version
10s
10s