Skip to content

Commit a25c332

Browse files
committed
feat: add openai inference provider
New optional provider. Relates to: RHAIENG-1198 Signed-off-by: Sébastien Han <seb@redhat.com>
1 parent d9dc908 commit a25c332

File tree

3 files changed

+7
-0
lines changed

3 files changed

+7
-0
lines changed

distribution/README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,7 @@ You can see an overview of the APIs and Providers the image ships with in the ta
1616
| inference | inline::sentence-transformers |
1717
| inference | remote::azure |
1818
| inference | remote::bedrock |
19+
| inference | remote::openai |
1920
| inference | remote::vertexai |
2021
| inference | remote::vllm |
2122
| inference | remote::watsonx |

distribution/build.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,7 @@ distribution_spec:
99
- provider_type: remote::watsonx
1010
- provider_type: remote::azure
1111
- provider_type: remote::vertexai
12+
- provider_type: remote::openai
1213
vector_io:
1314
- provider_type: inline::milvus
1415
- provider_type: remote::milvus

distribution/run.yaml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -54,6 +54,11 @@ providers:
5454
config:
5555
project: ${env.VERTEX_AI_PROJECT:=}
5656
location: ${env.VERTEX_AI_LOCATION:=us-central1}
57+
- provider_id: ${env.OPENAI_API_KEY:+openai}
58+
provider_type: remote::openai
59+
config:
60+
api_key: ${env.OPENAI_API_KEY:=}
61+
base_url: ${env.OPENAI_BASE_URL:=https://api.openai.com/v1}
5762
vector_io:
5863
- provider_id: milvus
5964
provider_type: inline::milvus

0 commit comments

Comments
 (0)