Consume workspace_connection in pipeline job

[bostdiek]

Is your feature request related to a problem? Please describe.
The customer we are working with wants to use AML for build an experimenation platform, and wants to use native openai sdk for the LLM components. To run the experiments on AML and keep parity between the deployed API and the experiment runner, we want to use the workspace connection. However, I have only seen how do use that within either a prompflow run or with the data import jobs.

Describe the solution you'd like

• We have created the connection in the Studio and now want to be able to connect to either our AzureOpenAI endpoint or our AzureCosmosDB within a pipeline component.

Describe alternatives you've considered

• Using keyvault

Additional context

It would be nice if a pipeline could have an input of a workspace connection or include this in some other fashion for the components to securly consume secrets.

[github-actions]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @Azure/azure-ml-sdk @azureml-github.

[swathipil]

Hi @bostdiek - Thanks for your feature request. We'll take a look asap!