Skip to content

Commit f787207

Browse files
committed
fix
Signed-off-by: wangli <wangli858794774@gmail.com>
1 parent 815dcb9 commit f787207

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/offline_inference_npu.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -37,7 +37,7 @@ def main():
3737
# Create a sampling params object.
3838
sampling_params = SamplingParams(max_tokens=100, temperature=0.0)
3939
# Create an LLM.
40-
llm = LLM(model="Qwen/Qwen2.5-0.5B-Instruct", enforce_eager=True)
40+
llm = LLM(model="Qwen/Qwen2.5-0.5B-Instruct")
4141

4242
# Generate texts from the prompts.
4343
outputs = llm.generate(prompts, sampling_params)

0 commit comments

Comments
 (0)