Skip to content

Commit c8a0ba1

Browse files
committed
userns: fixes from the review
Signed-off-by: Giuseppe Scrivano <[email protected]>
1 parent 72618fc commit c8a0ba1

File tree

1 file changed

+16
-91
lines changed

1 file changed

+16
-91
lines changed

keps/sig-node/127-user-namespaces/README.md

+16-91
Original file line numberDiff line numberDiff line change
@@ -22,18 +22,13 @@
2222
- [Phases](#phases)
2323
- [Phase 1: pods &quot;without&quot; volumes](#phase-1-pods-without-volumes)
2424
- [Phase 2: pods with volumes](#phase-2-pods-with-volumes)
25-
- [Phase 3: pod to pod isolation](#phase-3-pod-to-pod-isolation)
25+
- [Phase 3: TBD](#phase-3-tbd)
2626
- [Summary of the Proposed Changes](#summary-of-the-proposed-changes)
2727
- [Test Plan](#test-plan)
2828
- [Graduation Criteria](#graduation-criteria)
29-
- [pod.spec.useHostUsers graduation](#podspecusehostusers-graduation)
3029
- [Alpha](#alpha)
3130
- [Beta](#beta)
3231
- [GA](#ga)
33-
- [pod.spec.securityContext.userns.pod2podIsolation graduation](#podspecsecuritycontextusernspod2podisolation-graduation)
34-
- [Alpha](#alpha-1)
35-
- [Beta](#beta-1)
36-
- [GA](#ga-1)
3732
- [Upgrade / Downgrade Strategy](#upgrade--downgrade-strategy)
3833
- [Version Skew Strategy](#version-skew-strategy)
3934
- [Production Readiness Review Questionnaire](#production-readiness-review-questionnaire)
@@ -71,15 +66,6 @@ Items marked with (R) are required *prior to targeting to a milestone / release*
7166

7267
## Summary
7368

74-
This KEP adds a new `hostUsers` field to `pod.Spec` to allow to enable/disable
75-
using user namespaces for pods. Furthermore, it allows increased pod to pod
76-
isolation by means of `pod.spec.securityContext.userns.pod2podIsolation` field.
77-
78-
It allows users to place pods in different user namespaces increasing the
79-
pod-to-pod and pod-to-host isolation. This extra isolation increases the cluster
80-
security as it protects the host and other pods from malicious or compromised
81-
processes inside containers that are able to break into the host.
82-
8369
## Motivation
8470

8571
From
@@ -149,6 +135,9 @@ Here we use UIDs, but the same applies for GIDs.
149135

150136
## Proposal
151137

138+
This KEP adds a new `hostUsers` field to `pod.Spec` to allow to enable/disable
139+
using user namespaces for pods.
140+
152141
This proposal aims to support running pods inside user namespaces. This will
153142
improve the pod to node isolation (phase 1 and 2) and pod to pod isolation
154143
(phase 3) we currently have.
@@ -173,7 +162,7 @@ kernel module with `CAP_SYS_MODULE`.
173162
#### Story 3
174163

175164
As a cluster admin, I want to allow users to run their container as root
176-
without that process having root privileged on the host, so I can mitigate the
165+
without that process having root privileges on the host, so I can mitigate the
177166
impact of a compromised container.
178167

179168
#### Story 4
@@ -185,7 +174,7 @@ host files).
185174

186175
#### Story 5
187176

188-
As a cluster admin, I want to use different host UIDs/GIDs for pods running in
177+
As a cluster admin, I want to use different host UIDs/GIDs for pods running on
189178
the same node (whenever kernel/kube features allow it), so I can mitigate the
190179
impact a compromised pod can have on other pods and the node itself.
191180

@@ -199,20 +188,14 @@ impact a compromised pod can have on other pods and the node itself.
199188

200189
## Design Details
201190

202-
Note: Names are preliminary yet, I'm using field names to simplify explanations.
203-
204191
### Pod.spec changes
205192

206193
The following changes will be done to the pod.spec:
207194

208-
- `pod.spec.useHostUsers`: bool.
195+
- `pod.spec.hostUsers`: bool.
209196
If true or not present, uses the host user namespace (as today)
210197
If false, a new userns is created for the pod.
211-
This field will be used for phase 1, 2 and 3.
212-
213-
- `pod.spec.securityContext.userns.pod2podIsolation`: Enum
214-
If enabled, we will make the userns mappings be non-overlapping as much as possible.
215-
This field will be used in phase 3.
198+
By default it is set to `true`.
216199

217200
### Phases
218201

@@ -238,11 +221,9 @@ combination of the following volume types are used by the pod:
238221
This list of volumes was chosen as they can't be used to share files with other
239222
pods.
240223

241-
The mapping length will be 65535, mapping the range 0-65534 to the pod. This wide
242-
range makes sure most workloads will work fine.
243-
244-
The mapping will be chosen by the kubelet, using a simple algorithm to give
245-
different pods in this category ("without" volumes) a non-overlapping mapping.
224+
The mapping and the mapping length will be chosen by the kubelet,
225+
using a simple algorithm to give different pods in this category
226+
("without" volumes) a non-overlapping mapping.
246227
Giving non-overlapping mappings generates the best isolation for pods.
247228

248229
Furthermore, the node UID space of 2^32 can hold up to 2^16 pods each with a
@@ -267,56 +248,7 @@ listed vulnerabilities (as the host is protected from the container). It is also
267248
a trivial next-step to take, given that we have phase 1 implemented: just return
268249
the same mapping if the pod has other volumes.
269250

270-
#### Phase 3: pod to pod isolation
271-
272-
This phase will provide more isolation between pods that use volumes (as in
273-
phase 2) and requires another opt-in field:
274-
`pod.spec.securityContext.pod2podIsolation`.
275-
276-
This phase will try to not share the same mapping for all pods with volumes, as
277-
phase 2 does, but to achieve it some trade off needs to be made. This phase
278-
builds on the work of the previous phases and more details will be defined while
279-
the other phases evolve.
280-
281-
Here are some ideas so far:
282-
283-
One idea is to give different mappings to pods in different k8s namespaces or
284-
that use a different service account. This needs to be explored in further
285-
detail, but will probably impose limits to which workloads can run this (we need
286-
to expose a shorter mapping, less than 65535).
287-
288-
Another idea is to use id mapped mounts. This probably needs changes to the
289-
OCI runtime-spec, only works with certain filesystems and kernels that may take
290-
too long for some users to get (like managed services). Giuseppe started to
291-
experiment in crun with this
292-
[here](https://github.com/containers/crun/pull/780).
293-
294-
The value for `pod.spec.securityContext.pod2podIsolation` will be an enum, to
295-
select different strategies and allow room for future improvements.
296-
297-
It is being considered having a value that is "auto" for this fields, that
298-
will select the best strategy that your node supports. However, as different
299-
strategies will change the effective UID a container uses, if we add such an
300-
option the documentation will be VERY clear about the implications and
301-
automatizations will be provided whenever possible (we have some ideas on this
302-
front).
303-
304-
Another improvement suggested by @ddebroy to do here is:
305-
* Pods using also only [local ephemeral CSI volumes][csi-ephemeral-vol], as
306-
they share the same lifecycle of the pod, can be moved to use non-overlapping
307-
mappings.
308-
309-
This change can probably be done under the hood without the user noticing, to
310-
achieve more pod 2 pod isolation, and might not need the user to use
311-
`pod.spec.securityContext.pod2podIsolation`. However, some changes for the CSI
312-
vol to use the effective UID/GID might be needed and not trivial. @ddebroy has
313-
[kindly offered to help][csi-help] with this improvement
314-
315-
[csi-ephemeral-vol]: https://kubernetes-csi.github.io/docs/ephemeral-local-volumes.html#overview
316-
[csi-help]: https://github.com/kubernetes/enhancements/pull/3065/files#r762046107
317-
318-
If this phase turns out to be a lot of work, it will be left out as future work
319-
for other KEPs.
251+
#### Phase 3: TBD
320252

321253
### Summary of the Proposed Changes
322254

@@ -347,23 +279,16 @@ TBD
347279

348280
### Graduation Criteria
349281

350-
Graduation for each pod.spec field we introduce will be separate.
351-
352-
#### pod.spec.useHostUsers graduation
353-
354282
##### Alpha
355283

356284
##### Beta
357285

358286
##### GA
359287

360-
#### pod.spec.securityContext.userns.pod2podIsolation graduation
361-
362-
##### Alpha
363-
364-
##### Beta
365-
366-
##### GA
288+
- Make plans on whether, when, and how to enable by default
289+
- Should we reconsider making the mappings smaller by default?
290+
- Should we allow any way for users to for "more" IDs mapped? If yes, how many more and how?
291+
- Should we allow the user can ask for specific mappings?
367292

368293
### Upgrade / Downgrade Strategy
369294

0 commit comments

Comments
 (0)