Add Inference Feature to Skip Pinned Memory Creation (#1948) #18877

Job	Run time
build-macos (macos-13, static)	14m 9s
build-macos (macos-13, shared)	12m 41s
build-bazel (x86, linux.12xlarge, clang)	9m 27s
build-windows (windows-2022, static)	12m 0s
build-bazel (x86, linux.12xlarge, gcc)	10m 0s
build-windows (windows-2022, shared)	12m 30s
build-linux (x86, linux.12xlarge, static, gcc, 14.1.0)	26m 9s
build-linux (x86, linux.12xlarge, static, gcc, 9.5.0)	25m 51s
build-linux (x86, linux.12xlarge, shared, gcc, 9.5.0)	25m 49s
build-linux (arm, linux.arm64.m7g.4xlarge, static, clang, 16.0.6)	33m 7s
build-linux (x86, linux.12xlarge, shared, gcc, 14.1.0)	26m 36s
build-linux (x86, linux.12xlarge, static, clang, 16.0.6)	20m 6s
build-linux (arm, linux.arm64.m7g.4xlarge, shared, gcc, 14.1.0)	1h 24m 41s
build-linux (arm, linux.arm64.m7g.4xlarge, shared, clang, 16.0.6)	33m 1s
build-linux (arm, linux.arm64.m7g.4xlarge, static, gcc, 14.1.0)	1h 29m 1s
build-linux (x86, linux.12xlarge, shared, clang, 16.0.6)	19m 52s
	7h 35m 0s

Provide feedback