test: Add OpenAI frontend testing for LLM API backend#8040

krishung5 wants to merge 8 commits intomaintriton-inference-server/server:mainfrom

krish-llmapi-testtriton-inference-server/server:krish-llmapi-testCopy head branch name to clipboard