Skip to content

Commit 000d57c

Browse files
authored
Adjust sample async job (#1293)
* docs(async-job): add example async job that uses mounted secret Signed-off-by: Eric Dobroveanu <[email protected]> * docs(async-job): add sample using args instead of env Signed-off-by: Eric Dobroveanu <[email protected]> * docs(async-job): add kitchen sink example Signed-off-by: Eric Dobroveanu <[email protected]> * chore: adjust sampel to be representitive of typical use case Signed-off-by: Eric Dobroveanu <[email protected]> * chore: move AWS key in sample to the correct place Signed-off-by: Eric Dobroveanu <[email protected]> --------- Signed-off-by: Eric Dobroveanu <[email protected]>
1 parent 050b97c commit 000d57c

File tree

1 file changed

+39
-10
lines changed

1 file changed

+39
-10
lines changed

jobs/async-upload/samples/sample_job_s3_to_oci.yaml

Lines changed: 39 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,51 @@
11
---
2+
apiVersion: v1
3+
kind: Secret
4+
metadata:
5+
name: my-s3-credentials
6+
stringData:
7+
AWS_ACCESS_KEY_ID: minioadmin
8+
AWS_SECRET_ACCESS_KEY: minioadmin
9+
AWS_BUCKET: default
10+
AWS_REGION: us-east-1
11+
AWS_ENDPOINT_URL: http://minio.minio.svc.cluster.local:9000
12+
---
13+
apiVersion: v1
14+
kind: Secret
15+
metadata:
16+
name: my-oci-credentials
17+
type: kubernetes.io/dockerconfigjson
18+
stringData:
19+
.dockerconfigjson: '{"auths": {"distribution-registry-test-service.default.svc.cluster.local:5001": {"auth": "base64(username:password)","email": "[email protected]"}}}'
20+
ACCESS_TYPE: ["Push", "Pull"]
21+
OCI_HOST: distribution-registry-test-service.default.svc.cluster.local:5001
22+
---
223
apiVersion: batch/v1
324
kind: Job
425
metadata:
526
name: my-async-upload-job
627
spec:
728
template:
829
spec:
30+
volumes:
31+
- name: source-credentials
32+
secret:
33+
secretName: my-s3-credentials
34+
- name: destination-credentials
35+
secret:
36+
secretName: my-oci-credentials
937
restartPolicy: Never
1038
containers:
1139
- name: async-upload
1240
image: kubeflow/model-registry-async-job:local
41+
volumeMounts:
42+
- name: source-credentials
43+
readOnly: true
44+
mountPath: "/opt/creds/source"
45+
- name: destination-credentials
46+
readOnly: true
47+
mountPath: "/opt/creds/destination"
1348
env:
14-
- name: LOGLEVEL
15-
value: "DEBUG"
1649
- name: HTTP_PROXY
1750
value: ""
1851
- name: HTTPS_PROXY
@@ -22,22 +55,18 @@ spec:
2255
# ---- Source ----------
2356
- name: MODEL_SYNC_SOURCE_TYPE
2457
value: "s3"
25-
- name: MODEL_SYNC_SOURCE_AWS_BUCKET
26-
value: "default"
2758
- name: MODEL_SYNC_SOURCE_AWS_KEY
2859
value: "my-model"
29-
- name: MODEL_SYNC_SOURCE_AWS_ACCESS_KEY_ID
30-
value: "minioadmin"
31-
- name: MODEL_SYNC_SOURCE_AWS_SECRET_ACCESS_KEY
32-
value: "minioadmin"
33-
- name: MODEL_SYNC_SOURCE_AWS_ENDPOINT
34-
value: "http://minio.minio.svc.cluster.local:9000"
60+
- name: MODEL_SYNC_SOURCE_S3_CREDENTIALS_PATH
61+
value: "/opt/creds/source"
3562

3663
# ---- Destination -----
3764
- name: MODEL_SYNC_DESTINATION_TYPE
3865
value: "oci"
3966
- name: MODEL_SYNC_DESTINATION_OCI_URI
4067
value: "oci://distribution-registry-test-service.default.svc.cluster.local:5001/my-model:latest"
68+
- name: MODEL_SYNC_DESTINATION_OCI_CREDENTIALS_PATH
69+
value: "/opt/creds/destination"
4170

4271
# ---- Model Params ----
4372
- name: MODEL_SYNC_MODEL_ID

0 commit comments

Comments
 (0)