Skip to content

Commit 8a794a2

Browse files
committed
feat: fully switch to external provider module method
delete `providers.d` and depend on `module` for build and run. also delete `external_provider_dir` from both build and run yaml. this forces `build.py` to only install uv pip install llama_stack_provider_lmeval==0.2.4 uv pip install llama_stack_provider_trustyai_fms==0.2.2 rather than also grabbing dependencies like `kubernetes` Signed-off-by: Charlie Doern <cdoern@redhat.com>
1 parent 80e4bf6 commit 8a794a2

File tree

4 files changed

+2
-16
lines changed

4 files changed

+2
-16
lines changed

distribution/build.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,4 +42,3 @@ additional_pip_packages:
4242
- psycopg2-binary
4343
image_type: container
4444
image_name: llama-stack-rh
45-
external_providers_dir: distribution/providers.d

distribution/providers.d/remote/eval/trustyai_lmeval.yaml

Lines changed: 0 additions & 7 deletions
This file was deleted.

distribution/providers.d/remote/safety/trustyai_fms.yaml

Lines changed: 0 additions & 7 deletions
This file was deleted.

distribution/run.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -68,6 +68,7 @@ providers:
6868
safety:
6969
- provider_id: trustyai_fms
7070
provider_type: remote::trustyai_fms
71+
module: llama_stack_provider_trustyai_fms==0.2.2
7172
config:
7273
orchestrator_url: ${env.FMS_ORCHESTRATOR_URL:=}
7374
ssl_cert_path: ${env.FMS_SSL_CERT_PATH:=}
@@ -86,6 +87,7 @@ providers:
8687
eval:
8788
- provider_id: trustyai_lmeval
8889
provider_type: remote::trustyai_lmeval
90+
module: llama_stack_provider_lmeval==0.2.4
8991
config:
9092
use_k8s: ${env.TRUSTYAI_LMEVAL_USE_K8S:=true}
9193
base_url: ${env.VLLM_URL:=http://localhost:8000/v1}
@@ -177,4 +179,3 @@ tool_groups:
177179
provider_id: rag-runtime
178180
server:
179181
port: 8321
180-
external_providers_dir: /opt/app-root/src/.llama/providers.d

0 commit comments

Comments
 (0)