Add Inference Feature to Skip Pinned Memory Creation (#1948) #18834

Job	Run time
build-windows (windows-2022, static)	12m 13s
build-macos (macos-13, static)	20m 37s
build-bazel (x86, linux.12xlarge, clang)	9m 22s
build-bazel (x86, linux.12xlarge, gcc)	10m 0s
build-linux (x86, linux.12xlarge, shared, gcc, 14.1.0)	26m 27s
build-linux (x86, linux.12xlarge, shared, clang, 16.0.6)	19m 49s
build-linux (arm, linux.arm64.m7g.4xlarge, static, gcc, 14.1.0)	1h 21m 59s
build-linux (x86, linux.12xlarge, shared, gcc, 9.5.0)	25m 59s
build-linux (arm, linux.arm64.m7g.4xlarge, static, clang, 16.0.6)	33m 3s
build-linux (x86, linux.12xlarge, static, gcc, 14.1.0)	26m 23s
build-windows (windows-2022, shared)	12m 24s
build-linux (arm, linux.arm64.m7g.4xlarge, shared, gcc, 14.1.0)	1h 18m 19s
build-linux (x86, linux.12xlarge, static, clang, 16.0.6)	20m 21s
build-linux (arm, linux.arm64.m7g.4xlarge, shared, clang, 16.0.6)	32m 58s
build-linux (x86, linux.12xlarge, static, gcc, 9.5.0)	25m 56s
build-macos (macos-13, shared)	17m 29s
	7h 33m 19s

Provide feedback