Azure Open AI deployability as a workspace service within Azure TRE

[andrewsoltan]

Requesting ability to deploy the Azure OpenAI service as a service (e.g. as a workspace service) within an Azure TRE workspace, including secure networking within the TRE boundary

[marrobi]

@SvenAelterman was any progress made by your team in finding resource to do this? I know it was on a list somewhere.

If not @andrewsoltan have you people who could build this out with our assistance? What's the timescales you need this within?

[andrewsoltan]

Thanks all- we would be hoping to use this for a project funded by the MSR Accelerating Foundation models research grant (https://www.microsoft.com/en-us/research/collaboration/accelerating-foundation-models-research/phase-ii/ ) with an end date of end-Jan 2024, but appreciate that's quite tight!
Including @JaimieWi too for info

[SvenAelterman]

This did not make it in our scope, unfortunately.

[marrobi]

@JaimieWi if I make a start on something are you able to test and refine so we can hopefully get it merged into the project?

[SvenAelterman]

I would be happy to participate too. I don't have the availability to do the whole thing, but happy to test and review and help with design.

[JaimieWi]

@marrobi Yes, very happy to help where I can

[marrobi]

Ok, I've made a start here - #3812

I can't test myself due to subscription limits - I have no OpenAI capacity where I have my TRE deployed (and I'm currently travelling), but hopefully enough for @JaimieWi and @SvenAelterman to give it a test and feedback.

[martysharkey]

@marrobi did this get completed?

[marrobi]

@martysharkey I'm not sure if it got tested/used by @JaimieWi ?

It needs picking up at some point in the future, testing and merging into the repo.