Skip to content

Commit 9de6472

Browse files
committed
update quota part
1 parent 87097e1 commit 9de6472

2 files changed

Lines changed: 37 additions & 10 deletions

File tree

s6_the_cloud/cloud_setup.md

Lines changed: 30 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,13 @@
44

55
!!! info "Core Module"
66

7+
!!! warning "Interface changes"
8+
9+
The Google Cloud Platform (GCP) interface is constantly changing. Therefore, some of the screenshots and
10+
instructions in this module may be slightly outdated. However, the overall concepts and steps should still be
11+
applicable. If you are ever in doubt about how to do something in GCP, I recommend checking out the official
12+
[GCP documentation](https://cloud.google.com/docs).
13+
714
Google Cloud Platform (GCP) is the cloud service provided by Google. The key concept, or selling point, of any cloud
815
provider, is the idea of near-infinite resources. Without the cloud, it is simply not feasible to do many modern
916
deep learning and machine learning tasks because they cannot be scaled locally.
@@ -160,7 +167,8 @@ you want them to be able to do. The figure below shows how to do this.
160167
</figure>
161168
162169
What we are going to go through right now is how to increase the quotas for how many GPUs you have available for your
163-
project. By default, for any free accounts in GCP (or accounts using teaching credits) the default quota for GPUs that
170+
project. You can read more about quota types and levels [here](https://docs.cloud.google.com/docs/quotas/overview). By
171+
default, for any free accounts in GCP (or accounts using teaching credits) the default quota for GPUs that
164172
you can use is either 0 or 1 (their policies sometimes change). We will in the exercises below try to increase it.
165173
166174
### ❔ Exercises
@@ -169,13 +177,24 @@ you can use is either 0 or 1 (their policies sometimes change). We will in the e
169177
to a page where you can enable the service (may take some time). We are going to look more into this service
170178
in the next module.
171179
180+
!!! note
181+
182+
You can only request a quota increase for a service that you have enabled. After enabling a given service it may
183+
take 5-10 minutes before you can request a quota increase for that service.
184+
172185
2. Next go to the `IAM & Admin` page, again search for it in the top search bar. The remaining steps are illustrated
173186
in the figure below.
174187
175188
1. Go to the `quotas page`.
176189
177-
2. In the search field search for `GPUs (all regions)` (needs to match exactly, the search field is case-sensitive),
178-
such that you get the same quota as in the image.
190+
2. Next, lets adjust the filters such that we only see the GPU quotas. Start by setting `Type: Quota` (1).
191+
Afterwards, set the `Limit name:` to `GPUS-ALL-REGIONS-per-project` (needs to match exactly, the search field
192+
is case-sensitive) and you should now only see a single quota.
193+
{ .annotate }
194+
195+
1. :man_raising_hand: The alternative to choosing `Type: Quota` is choosing `Type: System limit` which is the
196+
hard upper bound imposed by Google. It will nearly always say `Unlimited` and in practice this is not
197+
relevant to us
179198
180199
3. In the limit, you can see what your current quota for the number of GPUs you can use is. Additionally, to the
181200
right of the limit, you can see the current usage. It is worth checking if you are ever in doubt if a job
@@ -189,25 +208,26 @@ you can use is either 0 or 1 (their policies sometimes change). We will in the e
189208
190209
<figure markdown>
191210
![Image](../figures/quotas.PNG){ width="1000" }
211+
<figcaption>
212+
Note that the exact name of the quota in the screenshot may have changed since Google sometimes updates their
213+
naming convention.
214+
</figcaption>
192215
</figure>
193216
217+
7. Now you just sit back and wait at the mercy of Google.
218+
194219
If you are ever running into errors when working in GPU that contain statements about `quotas` you can always try to
195220
go to this page and see what you are allowed to use currently and try to increase it. For example, when you get to
196221
training machine learning models using Vertex AI in the [next module](using_the_cloud.md), you would most likely
197222
need to ask for a quota increase for that service as well.
198223
199-
!!! note
200-
201-
You can only request a quota increase for a service that you have enabled. After enabling a given service it may take
202-
5-10 minutes before you can request a quota increase for that service.
203-
204224
<figure markdown>
205225
![Image](../figures/gcp_quotas.png){ width="1000" }
206226
</figure>
207227
208228
Finally, we want to note that a quota increase is sometimes not allowed within 24 hours of creating an account. If your
209-
request gets rejected, we recommend waiting a day and trying again. If this does still not work, you may need to use their
210-
services some more to show you are not a bot that wants to mine crypto.
229+
request gets rejected, we recommend waiting a day and trying again. If this does still not work, you may need to use
230+
their services some more to show you are not a bot that wants to mine crypto.
211231
212232
## Service accounts
213233

s6_the_cloud/using_the_cloud.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,13 @@
77

88
!!! info "Core Module"
99

10+
!!! warning "Interface changes"
11+
12+
The Google Cloud Platform (GCP) interface is constantly changing. Therefore, some of the screenshots and
13+
instructions in this module may be slightly outdated. However, the overall concepts and steps should still be
14+
applicable. If you are ever in doubt about how to do something in GCP, I recommend checking out the official
15+
[GCP documentation](https://cloud.google.com/docs).
16+
1017
In this set of exercises, we are going to get more familiar with using some of the resources that GCP offers.
1118

1219
## Compute

0 commit comments

Comments
 (0)