Add Inference Feature to Skip Pinned Memory Creation (#1948) #18860

Job	Run time
build-bazel (x86, linux.12xlarge, clang)	2m 59s
build-bazel (x86, linux.12xlarge, gcc)	1s
build-macos (macos-13, shared)	11m 4s
build-linux (x86, linux.12xlarge, static, gcc, 14.1.0)	1s
build-windows (windows-2022, shared)	10m 51s
build-linux (x86, linux.12xlarge, static, clang, 16.0.6)	1s
build-windows (windows-2022, static)	10m 50s
build-linux (x86, linux.12xlarge, shared, gcc, 14.1.0)	1s
build-linux (arm, linux.arm64.m7g.4xlarge, static, gcc, 14.1.0)	6m 22s
build-linux (x86, linux.12xlarge, shared, clang, 16.0.6)	1s
build-linux (arm, linux.arm64.m7g.4xlarge, static, clang, 16.0.6)	6m 47s
build-linux (x86, linux.12xlarge, static, gcc, 9.5.0)	1s
build-linux (arm, linux.arm64.m7g.4xlarge, shared, gcc, 14.1.0)	6m 24s
build-macos (macos-13, static)	11m 7s
build-linux (arm, linux.arm64.m7g.4xlarge, shared, clang, 16.0.6)	6m 5s
build-linux (x86, linux.12xlarge, shared, gcc, 9.5.0)	1s
	1h 12m 36s

Provide feedback