Skip to content

Commit 9d62f1c

Browse files
committed
chore: bump trustyai wheels
They include the support of the llama-stack-api. Signed-off-by: Sébastien Han <seb@redhat.com>
1 parent f35361a commit 9d62f1c

File tree

3 files changed

+14
-13
lines changed

3 files changed

+14
-13
lines changed

distribution/Containerfile

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,7 @@ RUN uv pip install \
1919
aiosqlite \
2020
asyncpg \
2121
autoevals \
22+
boto3 \
2223
chardet \
2324
einops \
2425
faiss-cpu \
@@ -49,13 +50,13 @@ RUN uv pip install \
4950
transformers \
5051
uvicorn
5152
RUN uv pip install \
52-
llama_stack_provider_lmeval==0.3.1
53+
llama_stack_provider_lmeval==0.4.0
5354
RUN uv pip install \
54-
llama_stack_provider_ragas==0.4.2
55+
llama_stack_provider_ragas==0.5.1
5556
RUN uv pip install \
56-
llama_stack_provider_ragas[remote]==0.4.2
57+
llama_stack_provider_ragas[remote]==0.5.1
5758
RUN uv pip install \
58-
llama_stack_provider_trustyai_fms==0.2.3
59+
llama_stack_provider_trustyai_fms==0.3.0
5960
RUN uv pip install --extra-index-url https://download.pytorch.org/whl/cpu 'torchao>=0.12.0' torch torchvision
6061
RUN uv pip install --no-deps sentence-transformers
6162
RUN uv pip install --no-cache --no-deps git+https://github.com/opendatahub-io/llama-stack.git@main

distribution/README.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44

55
This image contains the official Open Data Hub Llama Stack distribution, with all the packages and configuration needed to run a Llama Stack server in a containerized environment.
66

7-
The image is currently shipping with the Open Data Hub version of Llama Stack version [a73f4cc](https://github.com/opendatahub-io/llama-stack/commit/a73f4cc6127ff7c1d42543c2885f4a5d9a5460d1)
7+
The image is currently shipping with the Open Data Hub version of Llama Stack version [57b22a0](https://github.com/opendatahub-io/llama-stack/commit/57b22a07f798c09713ee80836306ff1584c376fa)
88

99
You can see an overview of the APIs and Providers the image ships with in the table below.
1010

@@ -13,9 +13,9 @@ You can see an overview of the APIs and Providers the image ships with in the ta
1313
| agents | inline::meta-reference | No || N/A |
1414
| datasetio | inline::localfs | No || N/A |
1515
| datasetio | remote::huggingface | No || N/A |
16-
| eval | inline::trustyai_ragas | Yes (version 0.4.2) || Set the `EMBEDDING_MODEL` environment variable |
17-
| eval | remote::trustyai_lmeval | Yes (version 0.3.1) || N/A |
18-
| eval | remote::trustyai_ragas | Yes (version 0.4.2) || Set the `KUBEFLOW_LLAMA_STACK_URL` environment variable |
16+
| eval | inline::trustyai_ragas | Yes (version 0.5.1) || Set the `EMBEDDING_MODEL` environment variable |
17+
| eval | remote::trustyai_lmeval | Yes (version 0.4.0) || N/A |
18+
| eval | remote::trustyai_ragas | Yes (version 0.5.1) || Set the `KUBEFLOW_LLAMA_STACK_URL` environment variable |
1919
| files | inline::localfs | No || N/A |
2020
| inference | inline::sentence-transformers | No || N/A |
2121
| inference | remote::azure | No || Set the `AZURE_API_KEY` environment variable |
@@ -24,7 +24,7 @@ You can see an overview of the APIs and Providers the image ships with in the ta
2424
| inference | remote::vertexai | No || Set the `VERTEX_AI_PROJECT` environment variable |
2525
| inference | remote::vllm | No || Set the `VLLM_URL` environment variable |
2626
| inference | remote::watsonx | No || Set the `WATSONX_API_KEY` environment variable |
27-
| safety | remote::trustyai_fms | Yes (version 0.2.3) || N/A |
27+
| safety | remote::trustyai_fms | Yes (version 0.3.0) || N/A |
2828
| scoring | inline::basic | No || N/A |
2929
| scoring | inline::braintrust | No || N/A |
3030
| scoring | inline::llm-as-judge | No || N/A |

distribution/build.yaml

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -16,16 +16,16 @@ distribution_spec:
1616
- provider_type: inline::faiss
1717
safety:
1818
- provider_type: remote::trustyai_fms
19-
module: llama_stack_provider_trustyai_fms==0.2.3
19+
module: llama_stack_provider_trustyai_fms==0.3.0
2020
agents:
2121
- provider_type: inline::meta-reference
2222
eval:
2323
- provider_type: remote::trustyai_lmeval
24-
module: llama_stack_provider_lmeval==0.3.1
24+
module: llama_stack_provider_lmeval==0.4.0
2525
- provider_type: inline::trustyai_ragas
26-
module: llama_stack_provider_ragas==0.4.2
26+
module: llama_stack_provider_ragas==0.5.1
2727
- provider_type: remote::trustyai_ragas
28-
module: llama_stack_provider_ragas[remote]==0.4.2
28+
module: llama_stack_provider_ragas[remote]==0.5.1
2929
datasetio:
3030
- provider_type: remote::huggingface
3131
- provider_type: inline::localfs

0 commit comments

Comments
 (0)