Skip to content

Commit 6bde942

Browse files
maxpumperlamaxpumperla
committed
course and module yaml files
Signed-off-by: Max Pumperla <max.pumperla@googlemail.com>
1 parent d0a838f commit 6bde942

File tree

139 files changed

+4583
-12921
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

139 files changed

+4583
-12921
lines changed

‎courses/foundations/Anyscale_For_Admins/02_00_Anyscale_Admin_Overview/module.yaml‎

Lines changed: 48 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,48 @@
1+
02_00_Anyscale_Admin_Overview:
2+
title: Anyscale Admin Overview
3+
description: Learn how to set up and manage an Anyscale Cloud in your own infrastructure,
4+
including deployment options (VMs vs. Kubernetes, managed vs. custom) and the
5+
resources required to run Ray clusters. You’ll also walk through an AWS EC2 example
6+
that explains key components like IAM roles and other foundational cloud resources,
7+
typically provisioned via the Anyscale CLI or Terraform.
8+
sources:
9+
- anyscale_administrator_overview.ipynb
10+
lessons:
11+
00_lesson:
12+
title: Anyscale Administrator Overview
13+
description: Learn how to set up and administer Anyscale in your infrastructure,
14+
including an overview of Anyscale Clouds, deployment types, and required resources.
15+
You’ll also walk through an example EC2 deployment using the Anyscale CLI
16+
to understand how an Anyscale Cloud is configured.
17+
01_lesson:
18+
title: 1. What is an Anyscale Cloud?
19+
description: Learn what an Anyscale Cloud is and how it abstracts and manages
20+
the infrastructure needed to run Ray clusters. You’ll understand its role
21+
as an isolated deployment layer between your Anyscale organization and the
22+
Ray projects you create.
23+
02_lesson:
24+
title: 2. Cloud Deployment Types
25+
description: Learn how to deploy Anyscale Clouds across different infrastructure
26+
options—virtual machines or Kubernetes—and choose the right deployment model
27+
(managed vs. custom) for your environment. You'll understand the supported
28+
platforms for each infrastructure type and how these choices impact setup
29+
and operations.
30+
03_lesson:
31+
title: 3. A Demonstrative Example of Resource Creation with AWS EC2
32+
description: Learn how to deploy Anyscale on AWS EC2 by creating the required
33+
cloud resources, guided by the “Architecture of an Anyscale Cloud runs on
34+
AWS EC2” diagram. You’ll see how modular Terraform components (e.g., the required
35+
`aws-anyscale-iam` module) provision IAM roles and policies for secure cross-account
36+
access.
37+
04_lesson:
38+
title: 3.1 IAM Role Definition
39+
description: Learn how to deploy an Anyscale cloud by defining and creating
40+
the two required AWS IAM roles, including the Anyscale control plane role.
41+
You’ll understand who assumes each role and what permissions and trust relationships
42+
are needed for Anyscale to manage your resources securely.
43+
05_lesson:
44+
title: 4. Register Anyscale Cloud to Your Cloud Provider
45+
description: Learn how to register your AWS infrastructure (VPC, subnets, S3
46+
bucket, and IAM roles) as an Anyscale Cloud deployment using the `anyscale
47+
cloud register` CLI command. By the end, you’ll have a unified Anyscale Cloud
48+
configured to run on your AWS account.

‎courses/foundations/Anyscale_For_Admins/02_01_VM_vs_K8s/module.yaml‎

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,28 @@
1+
02_01_VM_vs_K8s:
2+
title: Vm Vs K8S
3+
description: Learn how Anyscale deploys Ray on either Virtual Machines or Kubernetes,
4+
including what the Anyscale Operator manages on K8s. Compare VM vs. K8s across
5+
control, data, and execution layers to choose the right deployment model for your
6+
infrastructure and automation needs.
7+
sources:
8+
- anyscale_vm_vs_k8s.ipynb
9+
lessons:
10+
00_lesson:
11+
title: 'Deployment Options: Virtual Machines vs. Kubernetes'
12+
description: Learn how to deploy and manage Ray workloads on your existing Kubernetes
13+
infrastructure using the Anyscale Operator, a Kubernetes-native controller
14+
that provisions and orchestrates Ray clusters. You’ll understand when Kubernetes
15+
is a better fit than virtual machines and what the operator handles for you
16+
in production.
17+
01_lesson:
18+
title: 2. Virtual Machines (VM) vs. Kubernetes (K8s)
19+
description: Learn the key differences between VM-based and Kubernetes-based
20+
Anyscale deployments across the control, data, and workload execution layers.
21+
By the end, you’ll be able to choose the right option for your use case based
22+
on automation needs, required cloud/K8s access, and operational responsibilities.
23+
02_lesson:
24+
title: 3. (Optional) More Kubernetes Deployments Components
25+
description: Learn how Kubernetes Cluster Autoscaler and a load balancer controller
26+
extend Ray deployments by automatically scaling cluster nodes and enabling
27+
external access to Ray applications. You’ll also preview VM-based deployment
28+
options on AWS EC2 and GCP GCE using the Ray autoscaler.

‎courses/foundations/Anyscale_For_Admins/02_02a_Deploy_to_VM_AWS_EC2/module.yaml‎

Lines changed: 43 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,43 @@
1+
02_02a_Deploy_to_VM_AWS_EC2:
2+
title: 02A Deploy To Vm Aws Ec2
3+
description: Learn how to deploy Anyscale Ray on AWS EC2 using the `anyscale cloud
4+
register` workflow by setting up prerequisites, provisioning required AWS/Anyscale
5+
resources with Terraform, and registering the resulting cloud in Anyscale. By
6+
the end, you’ll have an EC2-backed Anyscale cloud ready for Ray installation and
7+
cluster use.
8+
sources:
9+
- deploy_to_ec2.ipynb
10+
lessons:
11+
00_lesson:
12+
title: 'Introduction: Deploy Anyscale Ray on AWS EC2 Instances'
13+
description: Learn how to deploy Anyscale Ray on AWS EC2 using the custom `anyscale
14+
cloud register` workflow, from setting up prerequisites (AWS CLI, credentials,
15+
Terraform) to completing the Ray installation and initial configuration.
16+
01_lesson:
17+
title: 1. Create Anyscale Resources with Terraform
18+
description: In this lesson, you’ll configure Terraform variables (via `variables.tf`
19+
and optional `terraform.tfvars`) and run `terraform init/plan/apply` to provision
20+
the required Anyscale resources in AWS. You’ll also learn to capture the `terraform
21+
apply` outputs needed to register your Anyscale cloud and troubleshoot common
22+
AWS service limit issues.
23+
02_lesson:
24+
title: 2. Register the Anyscale Cloud
25+
description: In this lesson, you’ll log into Anyscale and use your `terraform
26+
apply` outputs to register a new Anyscale Cloud via the `anyscale cloud register`
27+
command. By the end, you’ll have a successfully created cloud with your chosen
28+
`ANYSCALE_CLOUD_NAME`.
29+
03_lesson:
30+
title: 3. Test
31+
description: Learn how to validate your newly created Anyscale cluster by submitting
32+
a test job from the terminal and checking its status and logs in the Anyscale
33+
Console. You’ll also know where to view job results under **Jobs** in the
34+
console.
35+
04_lesson:
36+
title: 4. Cleanup
37+
description: Learn how to safely clean up your Anyscale-on-AWS setup by removing
38+
the Terraform-provisioned resources (VPC/subnets, IAM roles, S3, EFS, and
39+
related components). By the end, you’ll know how to tear down the environment
40+
to avoid ongoing AWS costs.
41+
05_lesson:
42+
title: 5. Conclusion
43+
description: ''

‎courses/foundations/Anyscale_For_Admins/02_02b_Deploy_to_VM_GCP_GCE/module.yaml‎

Lines changed: 47 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,47 @@
1+
02_02b_Deploy_to_VM_GCP_GCE:
2+
title: 02B Deploy To Vm Gcp Gce
3+
description: Learn how to deploy Anyscale Ray on GCP Compute Engine (GCE) by configuring
4+
GCP authentication and required APIs, provisioning infrastructure with the official
5+
Anyscale Terraform modules, and registering the resulting Anyscale cloud using
6+
the `anyscale cloud register` workflow.
7+
sources:
8+
- deploy_to_GCE.ipynb
9+
lessons:
10+
00_lesson:
11+
title: 'Introduction: Deploy Anyscale Ray on GCP Compute Engine Instances (GCE)'
12+
description: Learn how to set up the required GCP Compute Engine (GCE) infrastructure
13+
and Anyscale resources to deploy Ray on GCP. This lesson walks you through
14+
using the custom `anyscale cloud register` method to register and configure
15+
your cloud environment for deployment.
16+
01_lesson:
17+
title: Prerequisites
18+
description: In this lesson, you’ll set up the required Google Cloud environment
19+
by creating a Google Cloud Project and installing and configuring the Google
20+
Cloud SDK/CLI so you’re ready to follow along with the rest of the course.
21+
02_lesson:
22+
title: 1. Installation
23+
description: Learn how to authenticate with Google Cloud using application default
24+
credentials, set your active GCP project, and enable and verify the required
25+
APIs needed for deployment.
26+
03_lesson:
27+
title: 2. Create Anyscale Resources with Terraform
28+
description: In this lesson, you’ll configure Terraform variables (`terraform.tfvars`)
29+
and use the official Anyscale Terraform modules to provision the required
30+
Anyscale resources on GCP. You’ll run `terraform init/plan/apply` and capture
31+
the registration command output needed to register your Anyscale cloud.
32+
04_lesson:
33+
title: 3. Register the Anyscale Cloud
34+
description: In this lesson, you’ll log into Anyscale and use your `terraform
35+
apply` outputs to register a new Anyscale Cloud via the `anyscale cloud register`
36+
command. By the end, you’ll have a named Anyscale Cloud successfully created
37+
and ready to use.
38+
05_lesson:
39+
title: 4. Test
40+
description: Learn how to validate your newly created Anyscale cluster by submitting
41+
a test job from the command line. You’ll also learn how to monitor job status
42+
and view logs and results in the Anyscale Console.
43+
06_lesson:
44+
title: 5. Cleanup
45+
description: Learn how to safely tear down your Ray cluster and remove associated
46+
Anyscale cloud resources when you’re finished. You’ll also optionally empty
47+
and delete the GCS bucket to avoid lingering costs.

‎courses/foundations/Anyscale_For_Admins/02_03a_Deploy_to_K8s_New_AWS_EKS/module.yaml‎

Lines changed: 63 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,63 @@
1+
02_03a_Deploy_to_K8s_New_AWS_EKS:
2+
title: 03A Deploy To K8S New Aws Eks
3+
description: Learn how to deploy Anyscale Ray by creating a new AWS EKS–backed Anyscale
4+
Cloud using Terraform and required AWS tooling. You’ll configure prerequisites,
5+
provision the necessary AWS/Anyscale resources, then register the cloud with `anyscale
6+
cloud register` using the Terraform outputs.
7+
sources:
8+
- deploy_to_a_new_EKS.ipynb
9+
lessons:
10+
00_lesson:
11+
title: 'Introduction: Deploy Anyscale Ray on A New AWS EKS Cluster'
12+
description: Learn how to deploy Anyscale Cloud (Ray) on a brand-new AWS EKS
13+
cluster using the `anyscale cloud register` workflow. This lesson walks you
14+
through prerequisites, required tooling (AWS CLI, Terraform), and the AWS
15+
account/VPC/IAM setup needed to complete the deployment.
16+
01_lesson:
17+
title: 1. Create Anyscale Resources with Terraform
18+
description: Learn how to configure Terraform variables and run `init`, `plan`,
19+
and `apply` to provision the required Anyscale resources on AWS (EKS). You’ll
20+
also capture the `terraform apply` outputs—especially the Anyscale cloud registration
21+
command—needed for the next setup step.
22+
02_lesson:
23+
title: 2. Install Kubernetes Components
24+
description: Learn how to install and configure the core Kubernetes add-ons
25+
required by the Anyscale Operator on EKS—Cluster Autoscaler, AWS Load Balancer
26+
Controller, and NGINX Ingress Controller—using `kubectl` and Helm. You’ll
27+
also understand when and how to add the optional NVIDIA device plugin for
28+
GPU-enabled nodes.
29+
03_lesson:
30+
title: 3. Register the Anyscale Cloud
31+
description: In this lesson, you’ll log into Anyscale and use your Terraform
32+
apply outputs to register a new Anyscale Cloud via the `anyscale cloud register`
33+
command. By the end, you’ll have a named cloud successfully created and ready
34+
for use in Anyscale.
35+
04_lesson:
36+
title: 4. Install the Anyscale Operator
37+
description: Learn how to add the Anyscale Helm chart repository and use Helm
38+
to install or upgrade the Anyscale Operator in your Kubernetes cluster, configuring
39+
it with your cloud deployment ID. By the end, you’ll have the operator deployed
40+
and ready to manage Anyscale resources.
41+
05_lesson:
42+
title: 5. Verify the Installation
43+
description: Learn how to confirm your Anyscale installation is working by verifying
44+
that the Anyscale/Ray operator pods are running in Kubernetes and that your
45+
Anyscale cloud is properly registered using `kubectl` and the `anyscale` CLI.
46+
06_lesson:
47+
title: 6. Test
48+
description: Submit a sample job to validate your newly created Anyscale Kubernetes
49+
cluster, then monitor its status and logs from the CLI and Anyscale Console.
50+
You’ll also observe autoscaling behavior in Kubernetes and learn how the job’s
51+
compute configuration defines the Ray head and worker node resources.
52+
07_lesson:
53+
title: 7. Clean up
54+
description: Learn how to fully tear down your Anyscale setup by deleting the
55+
cloud, verifying removal, and emptying the associated S3 bucket. You’ll also
56+
uninstall the Anyscale operator and related Kubernetes resources (including
57+
optional ingress components) to prevent ongoing costs and leftover infrastructure.
58+
08_lesson:
59+
title: 8. Conclusion
60+
description: Wrap up the setup by confirming your Anyscale environment is successfully
61+
running on an existing AWS EKS cluster. You’ll review the AWS resources provisioned
62+
with Terraform and the key Kubernetes components installed (Cluster Autoscaler,
63+
AWS Load Balancer Controller, and NGINX Ingress).

‎courses/foundations/Anyscale_For_Admins/02_03b_Deploy_to_K8s_Existing_AWS_EKS/module.yaml‎

Lines changed: 80 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,80 @@
1+
02_03b_Deploy_to_K8s_Existing_AWS_EKS:
2+
title: 03B Deploy To K8S Existing Aws Eks
3+
description: Learn how to deploy Anyscale Ray on an existing AWS EKS (1.25+) cluster
4+
by provisioning required Anyscale resources with Terraform and then registering
5+
the cluster using the `anyscale cloud register` workflow. You’ll configure prerequisites,
6+
set Terraform variables, run `init/plan/apply`, and capture the outputs needed
7+
to complete cloud registration.
8+
sources:
9+
- deploy_to_an_existing_EKS.ipynb
10+
lessons:
11+
00_lesson:
12+
title: 'Introduction: Deploy Anyscale Ray on An Existing AWS EKS Cluster'
13+
description: ''
14+
01_lesson:
15+
title: Prerequisites
16+
description: Learn which tools and versions you need before deploying Anyscale
17+
Ray on an existing AWS EKS cluster, including installing and configuring the
18+
AWS CLI and Terraform. You’ll also see an alternative Terraform setup option
19+
using `tfenv` if Homebrew installation isn’t available.
20+
02_lesson:
21+
title: 1. Create Anyscale Resources with Terraform
22+
description: In this lesson, you’ll configure Terraform variables for an existing
23+
AWS EKS cluster and run `terraform init/plan/apply` to provision the Anyscale
24+
resources in your VPC. You’ll also capture the `terraform apply` outputs (including
25+
the Anyscale cloud registration command) needed to register the new Anyscale
26+
cloud.
27+
03_lesson:
28+
title: 2. Attach Required IAM Policies to Your existing EKS's Node Role
29+
description: Learn how to identify your Anyscale-related EKS node group and
30+
node IAM role, then attach the required S3 (from Terraform output) and EFS
31+
IAM policies so your nodes have the permissions needed for Anyscale. You’ll
32+
also capture key Terraform outputs required for the later cloud registration
33+
step.
34+
04_lesson:
35+
title: 3. Install Kubernetes Components
36+
description: In this lesson, you’ll install the Kubernetes components required
37+
by the Anyscale Operator on EKS—Cluster Autoscaler, AWS Load Balancer Controller,
38+
and Nginx Ingress—using Helm. You’ll also optionally set up the Nvidia device
39+
plugin to enable GPU support on your nodes.
40+
05_lesson:
41+
title: 4. Register the Anyscale Cloud
42+
description: In this lesson, you’ll log into Anyscale and use your `terraform
43+
apply` outputs to register a new Anyscale Cloud via the `anyscale cloud register`
44+
command. By the end, you’ll have a named Anyscale Cloud successfully created
45+
and ready for use.
46+
06_lesson:
47+
title: 5. Install the Anyscale Operator
48+
description: Learn how to add the Anyscale Helm chart repository and install
49+
or upgrade the Anyscale Operator in your Kubernetes cluster using Helm. You’ll
50+
also set the required cloud deployment ID to connect the operator to your
51+
Anyscale environment.
52+
07_lesson:
53+
title: 6. Verify the Installation
54+
description: Learn how to confirm your Anyscale installation is working by verifying
55+
that the Anyscale/Ray operator pods are running in Kubernetes and that your
56+
Anyscale cloud is properly registered using `kubectl` and the `anyscale` CLI.
57+
08_lesson:
58+
title: 7. Test
59+
description: Learn how to validate your newly created cluster by submitting
60+
a sample job from the terminal and monitoring its status and logs in the Anyscale
61+
Console. You’ll also observe Kubernetes pod scaling behavior and see how the
62+
job’s compute configuration defines the Ray head and worker resources used
63+
during execution.
64+
09_lesson:
65+
title: 8. Troubleshooting
66+
description: Learn how to diagnose and resolve common deployment issues by verifying
67+
required IAM permissions and other configuration settings. You’ll also fix
68+
missing Anyscale job logs by adding the necessary S3 cross-origin (CORS) permissions.
69+
10_lesson:
70+
title: 9. Clean up
71+
description: Learn how to fully tear down your Anyscale setup by deleting the
72+
cloud, verifying removal, and emptying the associated S3 bucket. You’ll also
73+
uninstall the Anyscale operator (and optional Nginx ingress) and delete the
74+
Kubernetes namespace to clean up remaining resources.
75+
11_lesson:
76+
title: 10. Conclusion
77+
description: Wrap up the setup by confirming your Anyscale environment is fully
78+
deployed on an existing AWS EKS cluster. You’ll review the AWS resources provisioned
79+
with Terraform and the key Kubernetes components installed—Cluster Autoscaler,
80+
AWS Load Balancer Controller, and Nginx.

0 commit comments

Comments
 (0)