Add Inference Feature to Skip Pinned Memory Creation (#1948) #15464

Job	Run time
build_artifact (x86, linux.24xlarge, ubuntu:22.04, default, 3.13, 6.3, clang)	44m 32s
build_artifact (x86, linux.24xlarge, ubuntu:22.04, default, 3.13, 6.4, gcc)	41m 47s
build_artifact (x86, linux.24xlarge, ubuntu:22.04, default, 3.13, 6.3, gcc)	43m 48s
build_artifact (x86, linux.24xlarge, ubuntu:22.04, genai, 3.13, 6.3, clang)	1h 17m 16s
build_artifact (x86, linux.24xlarge, ubuntu:22.04, genai, 3.13, 6.3, gcc)	1h 15m 32s
build_artifact (x86, linux.24xlarge, ubuntu:22.04, genai, 3.13, 6.4, clang)	2h 51m 46s
build_artifact (x86, linux.24xlarge, ubuntu:22.04, default, 3.13, 6.4, clang)	42m 8s
build_artifact (x86, linux.24xlarge, ubuntu:22.04, genai, 3.13, 6.4, gcc)	2h 54m 14s
test_and_publish_artifact (x86, linux.rocm.gpu.2, default, 3.13, 6.3, gcc)	24m 21s
test_and_publish_artifact (x86, linux.rocm.gpu.2, default, 3.13, 6.4, clang)	1h 24m 19s
test_and_publish_artifact (x86, linux.rocm.gpu.2, default, 3.13, 6.3, clang)	1h 4m 29s
test_and_publish_artifact (x86, linux.rocm.gpu.2, default, 3.13, 6.4, gcc)	1h 14m 16s
test_and_publish_artifact (x86, linux.rocm.gpu.2, genai, 3.13, 6.4, clang)	21m 3s
test_and_publish_artifact (x86, linux.rocm.gpu.2, genai, 3.13, 6.3, clang)	22m 32s
test_and_publish_artifact (x86, linux.rocm.gpu.2, genai, 3.13, 6.4, gcc)	19m 56s
test_and_publish_artifact (x86, linux.rocm.gpu.2, genai, 3.13, 6.3, gcc)	18m 15s
	16h 40m 14s

Provide feedback