Best practice of serviceId for AIServiceSelector #12281
HuskyDanny
started this conversation in
General
Replies: 1 comment 1 reply
-
The service id -> service mapping is really any way you want it to behave. If you want |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Since each chat completion instance needs a serviceId, and AIServiceSelector basically uses serviceId to select. Can I use $"service_{model_name}" as the name for the supported models?
My intention is to support multiple models like o3, 4o, claude. Since each of them needs an instance and a serviceId, so the serviceId to model is 11 mapping.
I post the question here because I am seeing the use of serviceId is more like a role based like chat_service, summarize_service. Is the model level granularity on serviceId a good practice? If not, how to get over the multiple models support scenario?
Beta Was this translation helpful? Give feedback.
All reactions