Skip to content

Commit 3696050

Browse files
Akashcodes732Akash Kaothalkar
andauthored
[Hardware][Powerpc] Fix VLLM_CPU_OMP_THREADS_BIND="auto" low CPU utilization for Power (#27734)
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com> Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
1 parent b2e65cb commit 3696050

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm/platforms/cpu.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -316,7 +316,8 @@ def check_and_update_config(cls, vllm_config: VllmConfig) -> None:
316316

317317
if (
318318
platform.system() == "Linux"
319-
and Platform.get_cpu_architecture() == CpuArchEnum.ARM
319+
and Platform.get_cpu_architecture()
320+
in (CpuArchEnum.ARM, CpuArchEnum.POWERPC)
320321
and not ("libomp" in ld_preload_str or "libgomp" in ld_preload_str)
321322
):
322323
# We need to LD_PRELOAD PyTorch's libgomp, otherwise only

0 commit comments

Comments
 (0)