Update scripts/inference.py

JRosenkranz · jjhursey · web-flow · commit 5aaf97589845 · 2025-06-04T12:24:32.000-04:00
this looks good to me

Co-authored-by: Josh Hursey &lt;4259120+jjhursey@users.noreply.github.com&gt;
diff --git a/scripts/inference.py b/scripts/inference.py
@@ -230,7 +230,7 @@
     "--stagger_update_lazyhandle",
     type=int,
     default=0,
-    help="Stagger update_lazyhandle to avoid OOM issues on the host"
+    help="Limit the number of concurrent processes executing the AIU update_lazyhandle phase. Set to 0 to allow all processes"
 )
 parser.add_argument(
     "--dist_timeout",

Original file line number	Diff line number	Diff line change
`@@ -230,7 +230,7 @@`
`230`	`230`	`"--stagger_update_lazyhandle",`
`231`	`231`	`type=int,`
`232`	`232`	`default=0,`
`233`		`- help="Stagger update_lazyhandle to avoid OOM issues on the host"`
	`233`	`+ help="Limit the number of concurrent processes executing the AIU update_lazyhandle phase. Set to 0 to allow all processes"`
`234`	`234`	`)`
`235`	`235`	`parser.add_argument(`
`236`	`236`	`"--dist_timeout",`