Update scripts/inference.py

JRosenkranz · jjhursey · web-flow · commit e8aa965894a7 · 2025-06-04T12:24:01.000-04:00
That looks good to me

Co-authored-by: Josh Hursey &lt;4259120+jjhursey@users.noreply.github.com&gt;
diff --git a/scripts/inference.py b/scripts/inference.py
@@ -224,7 +224,7 @@
     "--stagger_load",
     type=int,
     default=0,
-    help="Stagger model loading to avoid OOM issues on the host"
+    help="Limit the number of concurrent processes executing the model loading phase. Set to 0 to allow all processes"
 )
 parser.add_argument(
     "--stagger_update_lazyhandle",

Original file line number	Diff line number	Diff line change
`@@ -224,7 +224,7 @@`
`224`	`224`	`"--stagger_load",`
`225`	`225`	`type=int,`
`226`	`226`	`default=0,`
`227`		`- help="Stagger model loading to avoid OOM issues on the host"`
	`227`	`+ help="Limit the number of concurrent processes executing the model loading phase. Set to 0 to allow all processes"`
`228`	`228`	`)`
`229`	`229`	`parser.add_argument(`
`230`	`230`	`"--stagger_update_lazyhandle",`