Skip to content

Commit 5b8bf26

Browse files
authored
feat: add openai inference provider (#46)
# What does this PR do? New optional provider. Relates to: RHAIENG-1198 <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit - New Features - Added support for OpenAI as a remote inference provider. - Automatically enabled when OPENAI_API_KEY is set; supports configurable base URL (default: https://api.openai.com/v1). - Documentation - Updated provider list to include the OpenAI remote inference option. <!-- end of auto-generated comment: release notes by coderabbit.ai -->
2 parents d9dc908 + a25c332 commit 5b8bf26

File tree

3 files changed

+7
-0
lines changed

3 files changed

+7
-0
lines changed

distribution/README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,7 @@ You can see an overview of the APIs and Providers the image ships with in the ta
1616
| inference | inline::sentence-transformers |
1717
| inference | remote::azure |
1818
| inference | remote::bedrock |
19+
| inference | remote::openai |
1920
| inference | remote::vertexai |
2021
| inference | remote::vllm |
2122
| inference | remote::watsonx |

distribution/build.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,7 @@ distribution_spec:
99
- provider_type: remote::watsonx
1010
- provider_type: remote::azure
1111
- provider_type: remote::vertexai
12+
- provider_type: remote::openai
1213
vector_io:
1314
- provider_type: inline::milvus
1415
- provider_type: remote::milvus

distribution/run.yaml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -54,6 +54,11 @@ providers:
5454
config:
5555
project: ${env.VERTEX_AI_PROJECT:=}
5656
location: ${env.VERTEX_AI_LOCATION:=us-central1}
57+
- provider_id: ${env.OPENAI_API_KEY:+openai}
58+
provider_type: remote::openai
59+
config:
60+
api_key: ${env.OPENAI_API_KEY:=}
61+
base_url: ${env.OPENAI_BASE_URL:=https://api.openai.com/v1}
5762
vector_io:
5863
- provider_id: milvus
5964
provider_type: inline::milvus

0 commit comments

Comments
 (0)