|
1 | 1 | # NvFractions GPU Sharing |
2 | 2 |
|
3 | | -NvFractions is one of KAI Scheduler's operator-backed GPU-sharing mode. It uses CUDA |
| 3 | +NvFractions is one of KAI Scheduler's operator-backed GPU-sharing modes. It uses CUDA |
4 | 4 | memory limits to enforce a GPU-memory boundary for each fractional workload. |
5 | 5 | The `gpu-sharing` operator configures the runtime support for those limits and |
6 | 6 | reports when GPU nodes are ready to accept NvFractions workloads. KAI uses the |
@@ -47,7 +47,7 @@ Ready-to-apply examples are available in the parent directory: |
47 | 47 |
|
48 | 48 | ### Dynamic fraction - Allow a workload to grow when memory is available |
49 | 49 |
|
50 | | -nvFraction`request` and `limit` operate in a similar way to the standard k8s request and limit. |
| 50 | +NvFraction `request` and `limit` operate in a similar way to the standard k8s request and limit. |
51 | 51 | Set a lower `request` and a higher `limit` when a workload has a known baseline |
52 | 52 | but can make useful progress with spare GPU memory. The request is its |
53 | 53 | guaranteed scheduling allocation; it may use memory up to its limit while that |
@@ -80,9 +80,9 @@ shows the annotation in context. |
80 | 80 |
|
81 | 81 |  |
82 | 82 |
|
83 | | -Two pods requiring diffrent gpu compute mode cannot share the same device. |
| 83 | +Two pods requiring different gpu compute mode cannot share the same device. |
84 | 84 | Because of this, KAI keeps workloads that use different compute-sharing modes |
85 | | -in separatefractional GPU groups. A pod that requests `sm-sharing` is therefore not |
| 85 | +in separate fractional GPU groups. A pod that requests `sm-sharing` is therefore not |
86 | 86 | placed with a `time-slicing` pod, and the reverse is also true. |
87 | 87 |
|
88 | 88 | ### Choosing the right compute mode |
|
0 commit comments