22
22
- [ Phases] ( #phases )
23
23
- [ Phase 1: pods " ; without" ; volumes] ( #phase-1-pods-without-volumes )
24
24
- [ Phase 2: pods with volumes] ( #phase-2-pods-with-volumes )
25
- - [ Phase 3: pod to pod isolation ] ( #phase-3-pod-to-pod-isolation )
25
+ - [ Phase 3: TBD ] ( #phase-3-tbd )
26
26
- [ Summary of the Proposed Changes] ( #summary-of-the-proposed-changes )
27
27
- [ Test Plan] ( #test-plan )
28
28
- [ Graduation Criteria] ( #graduation-criteria )
29
- - [ pod.spec.useHostUsers graduation] ( #podspecusehostusers-graduation )
30
29
- [ Alpha] ( #alpha )
31
30
- [ Beta] ( #beta )
32
31
- [ GA] ( #ga )
33
- - [ pod.spec.securityContext.userns.pod2podIsolation graduation] ( #podspecsecuritycontextusernspod2podisolation-graduation )
34
- - [ Alpha] ( #alpha-1 )
35
- - [ Beta] ( #beta-1 )
36
- - [ GA] ( #ga-1 )
37
32
- [ Upgrade / Downgrade Strategy] ( #upgrade--downgrade-strategy )
38
33
- [ Version Skew Strategy] ( #version-skew-strategy )
39
34
- [ Production Readiness Review Questionnaire] ( #production-readiness-review-questionnaire )
@@ -71,15 +66,6 @@ Items marked with (R) are required *prior to targeting to a milestone / release*
71
66
72
67
## Summary
73
68
74
- This KEP adds a new ` hostUsers ` field to ` pod.Spec ` to allow to enable/disable
75
- using user namespaces for pods. Furthermore, it allows increased pod to pod
76
- isolation by means of ` pod.spec.securityContext.userns.pod2podIsolation ` field.
77
-
78
- It allows users to place pods in different user namespaces increasing the
79
- pod-to-pod and pod-to-host isolation. This extra isolation increases the cluster
80
- security as it protects the host and other pods from malicious or compromised
81
- processes inside containers that are able to break into the host.
82
-
83
69
## Motivation
84
70
85
71
From
@@ -149,6 +135,9 @@ Here we use UIDs, but the same applies for GIDs.
149
135
150
136
## Proposal
151
137
138
+ This KEP adds a new ` hostUsers ` field to ` pod.Spec ` to allow to enable/disable
139
+ using user namespaces for pods.
140
+
152
141
This proposal aims to support running pods inside user namespaces. This will
153
142
improve the pod to node isolation (phase 1 and 2) and pod to pod isolation
154
143
(phase 3) we currently have.
@@ -173,7 +162,7 @@ kernel module with `CAP_SYS_MODULE`.
173
162
#### Story 3
174
163
175
164
As a cluster admin, I want to allow users to run their container as root
176
- without that process having root privileged on the host, so I can mitigate the
165
+ without that process having root privileges on the host, so I can mitigate the
177
166
impact of a compromised container.
178
167
179
168
#### Story 4
@@ -185,7 +174,7 @@ host files).
185
174
186
175
#### Story 5
187
176
188
- As a cluster admin, I want to use different host UIDs/GIDs for pods running in
177
+ As a cluster admin, I want to use different host UIDs/GIDs for pods running on
189
178
the same node (whenever kernel/kube features allow it), so I can mitigate the
190
179
impact a compromised pod can have on other pods and the node itself.
191
180
@@ -199,20 +188,14 @@ impact a compromised pod can have on other pods and the node itself.
199
188
200
189
## Design Details
201
190
202
- Note: Names are preliminary yet, I'm using field names to simplify explanations.
203
-
204
191
### Pod.spec changes
205
192
206
193
The following changes will be done to the pod.spec:
207
194
208
- - ` pod.spec.useHostUsers ` : bool.
195
+ - ` pod.spec.hostUsers ` : bool.
209
196
If true or not present, uses the host user namespace (as today)
210
197
If false, a new userns is created for the pod.
211
- This field will be used for phase 1, 2 and 3.
212
-
213
- - ` pod.spec.securityContext.userns.pod2podIsolation ` : Enum
214
- If enabled, we will make the userns mappings be non-overlapping as much as possible.
215
- This field will be used in phase 3.
198
+ By default it is set to ` true ` .
216
199
217
200
### Phases
218
201
@@ -238,11 +221,9 @@ combination of the following volume types are used by the pod:
238
221
This list of volumes was chosen as they can't be used to share files with other
239
222
pods.
240
223
241
- The mapping length will be 65535, mapping the range 0-65534 to the pod. This wide
242
- range makes sure most workloads will work fine.
243
-
244
- The mapping will be chosen by the kubelet, using a simple algorithm to give
245
- different pods in this category ("without" volumes) a non-overlapping mapping.
224
+ The mapping and the mapping length will be chosen by the kubelet,
225
+ using a simple algorithm to give different pods in this category
226
+ ("without" volumes) a non-overlapping mapping.
246
227
Giving non-overlapping mappings generates the best isolation for pods.
247
228
248
229
Furthermore, the node UID space of 2^32 can hold up to 2^16 pods each with a
@@ -267,56 +248,7 @@ listed vulnerabilities (as the host is protected from the container). It is also
267
248
a trivial next-step to take, given that we have phase 1 implemented: just return
268
249
the same mapping if the pod has other volumes.
269
250
270
- #### Phase 3: pod to pod isolation
271
-
272
- This phase will provide more isolation between pods that use volumes (as in
273
- phase 2) and requires another opt-in field:
274
- ` pod.spec.securityContext.pod2podIsolation ` .
275
-
276
- This phase will try to not share the same mapping for all pods with volumes, as
277
- phase 2 does, but to achieve it some trade off needs to be made. This phase
278
- builds on the work of the previous phases and more details will be defined while
279
- the other phases evolve.
280
-
281
- Here are some ideas so far:
282
-
283
- One idea is to give different mappings to pods in different k8s namespaces or
284
- that use a different service account. This needs to be explored in further
285
- detail, but will probably impose limits to which workloads can run this (we need
286
- to expose a shorter mapping, less than 65535).
287
-
288
- Another idea is to use id mapped mounts. This probably needs changes to the
289
- OCI runtime-spec, only works with certain filesystems and kernels that may take
290
- too long for some users to get (like managed services). Giuseppe started to
291
- experiment in crun with this
292
- [ here] ( https://github.com/containers/crun/pull/780 ) .
293
-
294
- The value for ` pod.spec.securityContext.pod2podIsolation ` will be an enum, to
295
- select different strategies and allow room for future improvements.
296
-
297
- It is being considered having a value that is "auto" for this fields, that
298
- will select the best strategy that your node supports. However, as different
299
- strategies will change the effective UID a container uses, if we add such an
300
- option the documentation will be VERY clear about the implications and
301
- automatizations will be provided whenever possible (we have some ideas on this
302
- front).
303
-
304
- Another improvement suggested by @ddebroy to do here is:
305
- * Pods using also only [ local ephemeral CSI volumes] [ csi-ephemeral-vol ] , as
306
- they share the same lifecycle of the pod, can be moved to use non-overlapping
307
- mappings.
308
-
309
- This change can probably be done under the hood without the user noticing, to
310
- achieve more pod 2 pod isolation, and might not need the user to use
311
- ` pod.spec.securityContext.pod2podIsolation ` . However, some changes for the CSI
312
- vol to use the effective UID/GID might be needed and not trivial. @ddebroy has
313
- [ kindly offered to help] [ csi-help ] with this improvement
314
-
315
- [ csi-ephemeral-vol ] : https://kubernetes-csi.github.io/docs/ephemeral-local-volumes.html#overview
316
- [ csi-help ] : https://github.com/kubernetes/enhancements/pull/3065/files#r762046107
317
-
318
- If this phase turns out to be a lot of work, it will be left out as future work
319
- for other KEPs.
251
+ #### Phase 3: TBD
320
252
321
253
### Summary of the Proposed Changes
322
254
@@ -347,23 +279,16 @@ TBD
347
279
348
280
### Graduation Criteria
349
281
350
- Graduation for each pod.spec field we introduce will be separate.
351
-
352
- #### pod.spec.useHostUsers graduation
353
-
354
282
##### Alpha
355
283
356
284
##### Beta
357
285
358
286
##### GA
359
287
360
- #### pod.spec.securityContext.userns.pod2podIsolation graduation
361
-
362
- ##### Alpha
363
-
364
- ##### Beta
365
-
366
- ##### GA
288
+ - Make plans on whether, when, and how to enable by default
289
+ - Should we reconsider making the mappings smaller by default?
290
+ - Should we allow any way for users to for "more" IDs mapped? If yes, how many more and how?
291
+ - Should we allow the user can ask for specific mappings?
367
292
368
293
### Upgrade / Downgrade Strategy
369
294
0 commit comments