RHAIENG-2131: Add S3 remote provider configs to LLS midstream container.

This MR adds S3 remote provider configs to LLS midstream container.

Signed-off-by: Mustafa Elbehery <melbeher@redhat.com>

Closes https://issues.redhat.com/browse/RHAIENG-2131

Author: Elbehery

distribution/README.md

@@ -17,6 +17,7 @@ You can see an overview of the APIs and Providers the image ships with in the ta
 | eval | remote::trustyai_lmeval | Yes (version 0.3.1) | ✅ | N/A |
 | eval | remote::trustyai_ragas | Yes (version 0.4.2) | ❌ | Set the `KUBEFLOW_LLAMA_STACK_URL` environment variable |
 | files | inline::localfs | No | ✅ | N/A |
+| files | remote::s3 | No | ❌ | Set the `S3_BUCKET_NAME` environment variable |
 | inference | inline::sentence-transformers | No | ✅ | N/A |
 | inference | remote::azure | No | ❌ | Set the `AZURE_API_KEY` environment variable |
 | inference | remote::bedrock | No | ❌ | Set the `AWS_ACCESS_KEY_ID` environment variable |

distribution/run.yaml

@@ -205,6 +205,18 @@ providers:
       metadata_store:
         type: sqlite
         db_path: /opt/app-root/src/.llama/distributions/rh/files_metadata.db
+  - provider_id: ${env.S3_BUCKET_NAME:+s3}
+    provider_type: remote::s3
+    config:
+      bucket_name: ${env.S3_BUCKET_NAME}
+      region: ${env.AWS_REGION:=us-east-1}
+      aws_access_key_id: ${env.AWS_ACCESS_KEY_ID:=}
+      aws_secret_access_key: ${env.AWS_SECRET_ACCESS_KEY:=}
+      endpoint_url: ${env.S3_ENDPOINT_URL:=}
+      auto_create_bucket: ${env.S3_AUTO_CREATE_BUCKET:=false}
+      metadata_store:
+        table_name: s3_files_metadata
+        backend: sql_default
 metadata_store:
   type: sqlite
   db_path: /opt/app-root/src/.llama/distributions/rh/registry.db