Commit 052d06c
committed
refactor: Make base client concrete and usable
The openAIModelServerClient could not be instantiated directly as it
declared no supported APIs. While this may have been intended to
enforce it as a base class, making it concrete provides more
flexibility.
This change allows the client to be used with any generic
OpenAI-compatible endpoint. It also centralizes the API list so
redundant overrides can be removed from the vLLM, TGI, and SGLang
subclasses, improving maintainability.1 parent 86b7ffb commit 052d06c
File tree
4 files changed
+2
-10
lines changed- inference_perf/client/modelserver
4 files changed
+2
-10
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
130 | 130 | | |
131 | 131 | | |
132 | 132 | | |
133 | | - | |
| 133 | + | |
134 | 134 | | |
135 | 135 | | |
136 | 136 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
48 | 48 | | |
49 | 49 | | |
50 | 50 | | |
51 | | - | |
52 | | - | |
53 | 51 | | |
54 | 52 | | |
55 | 53 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
46 | 46 | | |
47 | 47 | | |
48 | 48 | | |
49 | | - | |
50 | | - | |
51 | | - | |
52 | | - | |
| 49 | + | |
53 | 50 | | |
54 | 51 | | |
55 | 52 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
48 | 48 | | |
49 | 49 | | |
50 | 50 | | |
51 | | - | |
52 | | - | |
53 | | - | |
54 | 51 | | |
55 | 52 | | |
56 | 53 | | |
| |||
0 commit comments