@@ -38,106 +38,92 @@ This repository offers a series of hands-on labs designed to enhance your unders
3838
39391 . ** [ API Labs] ( ./Labs/API_Labs ) **
4040 - ** Objective:** Learn to develop and deploy APIs for ML models.
41- - ** Key Topics:**
42- - Flask and FastAPI basics
43- - Building and serving prediction APIs
41+ - ** Sub-Labs:**
42+ - ** [ FLASK_GCP_LAB] ( ./Labs/API_Labs/FLASK_GCP_LAB ) :** Flask lab data.
43+ - ** [ FastAPI Labs] ( ./Labs/API_Labs/FastAPI_Labs ) :** FastAPI lab details.
44+ - ** [ Streamlit Labs] ( ./Labs/API_Labs/Streamlit_Labs ) :** Streamlit README - updated.
4445
45462 . ** [ Airflow Labs] ( ./Labs/Airflow_Labs ) **
4647 - ** Objective:** Gain practical experience with Apache Airflow for orchestrating complex data workflows.
47- - ** Key Topics:**
48- - DAG creation and scheduling
49- - Task dependencies and monitoring
48+ - ** Sub-Labs:**
49+ - ** [ Lab 1] ( ./Labs/Airflow_Labs/Lab_1 ) :** Basic Airflow setup and DAGs.
50+ - ** [ Lab 2] ( ./Labs/Airflow_Labs/Lab_2 ) :** Advanced DAG dependencies and scheduling.
51+ - ** [ assets] ( ./Labs/Airflow_Labs/assets ) :** Contains additional assets for Airflow labs.
5052
51533 . ** [ CloudFunction Labs] ( ./Labs/CloudFunction_Labs ) **
5254 - ** Objective:** Learn how to deploy lightweight functions using cloud-based services.
53- - ** Key Topics :**
54- - Cloud Function basics
55- - Event-driven programming
55+ - ** Sub-Labs :**
56+ - ** [ Lab1-CloudFunction Setup ] ( ./Labs/CloudFunction_Labs/Lab1-CloudFunction_Setup ) : ** Setting up Google Cloud Functions.
57+ - ** [ Lab2-CloudFunction Intermediate ] ( ./Labs/CloudFunction_Labs/Lab2-CloudFunction_Intermediate ) : ** Intermediate Cloud Function concepts and use cases.
5658
57594 . ** [ Data Labs] ( ./Labs/Data_Labs ) **
5860 - ** Objective:** Understand data engineering and preprocessing steps.
59- - ** Key Topics:**
60- - Data cleaning and transformation
61- - Data pipeline setup
61+ - ** Sub-Labs:**
62+ - ** [ Apache] ( ./Labs/Data_Labs/Apache ) :** Apache setup for data handling.
63+ - ** [ DVC Labs/Lab 1] ( ./Labs/Data_Labs/DVC_Labs/Lab_1 ) :** DVC setup and basic commands.
64+ - ** [ Data Labeling Labs] ( ./Labs/Data_Labs/Data_Labeling_Labs ) :** Lab focused on data labeling processes.
6265
63665 . ** [ Data Storage & Warehouse Labs] ( ./Labs/Data_Storage_Warehouse_Labs ) **
6467 - ** Objective:** Explore data storage solutions and data warehousing.
65- - ** Key Topics:**
66- - Data warehousing concepts
67- - Storage optimization and management
68+ - ** Sub-Labs:**
69+ - ** [ Lab1] ( ./Labs/Data_Storage_Warehouse_Labs/Lab1 ) :** Introduction to data warehousing.
70+ - ** [ Lab2] ( ./Labs/Data_Storage_Warehouse_Labs/Lab2 ) :** Advanced data storage techniques.
71+ - ** [ Lab3] ( ./Labs/Data_Storage_Warehouse_Labs/Lab3 ) :** Optimization and data retrieval practices.
6872
69736 . ** [ Docker Container Labs] ( ./Labs/Docker_Container_Labs ) **
7074 - ** Objective:** Learn containerization techniques for ML applications.
71- - ** Key Topics :**
72- - Docker basics
73- - Creating and managing containers
75+ - ** Sub-Labs :**
76+ - ** [ Week7_Docker_Container ] ( ./Labs/Docker_Container_Labs/Week7_Docker_Container ) : ** Introduction to Docker containers.
77+ - ** [ Week8_Docker_Container ] ( ./Labs/Docker_Container_Labs/Week8_Docker_Container ) : ** Advanced Docker techniques and orchestration.
7478
75797 . ** [ ELK Labs] ( ./Labs/ELK_Labs ) **
7680 - ** Objective:** Set up logging and monitoring using the ELK stack.
77- - ** Key Topics:**
78- - Elasticsearch, Logstash, and Kibana integration
79- - Monitoring data pipelines
81+ - ** Sub-Labs:**
82+ - ** [ Lab1_Setup_Windows_WSL_Ubuntu] ( ./Labs/ELK_Labs/Lab1_Setup_Windows_WSL_Ubuntu ) :** ELK setup on Windows with WSL.
83+ - ** [ Lab2_ELK_Setup_Mac] ( ./Labs/ELK_Labs/Lab2_ELK_Setup_Mac ) :** ELK setup on macOS.
84+ - ** [ Lab3_Example] ( ./Labs/ELK_Labs/Lab3_Example ) :** Example of ELK in practice.
8085
81868 . ** [ Experiment Tracking Labs] ( ./Labs/Experiment_Tracking_Labs ) **
8287 - ** Objective:** Track and manage ML experiments.
83- - ** Key Topics :**
84- - Logging metrics and parameters
85- - Versioning experiments
88+ - ** Sub-Labs :**
89+ - ** [ Logging Labs ] ( ./Labs/Experiment_Tracking_Labs/Logging_Labs ) : ** Tracking logs for model training.
90+ - ** [ Mlflow Labs ] ( ./Labs/Experiment_Tracking_Labs/Mlflow_Labs ) : ** Using MLflow for experiment tracking.
8691
87929 . ** GCP Labs**
88- - ** [ Cloud Composer Labs] ( ./Labs/GCP_Labs/Cloud_Composer_Labs ) **
89- - ** Objective:** Learn how to use Google Cloud Composer for managing and orchestrating workflows.
90- - ** Key Topics:**
91- - Airflow integration in GCP
92- - Workflow automation and scheduling
93-
94- - ** [ Compute Engine Labs] ( ./Labs/GCP_Labs/Compute_Engine_Labs ) **
95- - ** Objective:** Gain hands-on experience with Google Compute Engine for scalable virtual machine instances.
96- - ** Key Topics:**
97- - Setting up and managing VMs
98- - Using Compute Engine for ML model training
99-
100- - ** [ KServe Labs] ( ./Labs/GCP_Labs/KServe_Labs ) **
101- - ** Objective:** Explore KServe for serving ML models at scale on Kubernetes.
102- - ** Key Topics:**
103- - Model serving with KServe
104- - Scaling models on Kubernetes
105-
106- - ** [ Kubernetes Labs] ( ./Labs/GCP_Labs/Kubernetes_Labs ) **
107- - ** Objective:** Learn Kubernetes basics and deploy ML workloads in a managed Kubernetes environment.
108- - ** Key Topics:**
109- - GKE setup and management
110- - Deploying containers for ML
111-
112- - ** [ Vertex AI Labs] ( ./Labs/GCP_Labs/Vertex_AI ) **
113- - ** Objective:** Understand and utilize Vertex AI for end-to-end ML workflows.
114- - ** Key Topics:**
115- - Managed datasets, training, and deployment
116- - Model monitoring and pipeline automation
93+ - ** [ Cloud Composer Labs] ( ./Labs/GCP_Labs/Cloud_Composer_Labs ) :** Set up and manage workflows with Cloud Composer.
94+ - ** [ Compute Engine Labs] ( ./Labs/GCP_Labs/Compute_Engine_Labs ) :** Hands-on with Google Compute Engine.
95+ - ** [ KServe Labs] ( ./Labs/GCP_Labs/KServe_Labs ) :** Serving ML models with KServe on Kubernetes.
96+ - ** [ Kubernetes Labs] ( ./Labs/GCP_Labs/Kubernetes_Labs ) :** Running and managing containers on GKE.
97+ - ** [ Vertex AI Labs] ( ./Labs/GCP_Labs/Vertex_AI ) :** End-to-end ML workflows with Vertex AI.
11798
1189910 . ** [ GitHub Labs] ( ./Labs/Github_Labs ) **
119100 - ** Objective:** Implement GitHub Actions for CI/CD.
120- - ** Key Topics:**
121- - Setting up workflows
122- - Automating testing and deployment
101+ - ** Sub-Labs:**
102+ - ** [ GitHub_Actions_GCP_Lab_beginner] ( ./Labs/Github_Labs/GitHub_Actions_GCP_Lab_beginner ) :** Beginner-level CI/CD with GitHub Actions.
103+ - ** [ Lab1] ( ./Labs/Github_Labs/Lab1 ) :** Basics of GitHub Actions.
104+ - ** [ Lab2] ( ./Labs/Github_Labs/Lab2 ) :** Intermediate CI/CD practices with GitHub.
105+ - ** [ github-actions-gcp-intermediate-lab] ( ./Labs/Github_Labs/github-actions-gcp-intermediate-lab ) :** Intermediate GCP integration with GitHub Actions.
123106
12410711 . ** [ Kubeflow Labs] ( ./Labs/Kubeflow_Labs ) **
125108 - ** Objective:** Orchestrate ML workflows with Kubeflow.
126- - ** Key Topics :**
127- - Kubeflow Pipelines
128- - Model management
109+ - ** Sub-Labs :**
110+ - ** [ Lab1- Kubeflow Setup ] ( ./Labs/Kubeflow_Labs/Lab1-Kubeflow_Setup ) : ** Setting up Kubeflow environment.
111+ - ** [ Lab2-Kubeflow Katib ] ( ./Labs/Kubeflow_Labs/Lab2-Kubeflow_Katib ) : ** Hyperparameter tuning with Katib in Kubeflow.
129112
13011312 . ** [ MLMD Labs] ( ./Labs/MLMD_Labs ) **
131114 - ** Objective:** Understand ML Metadata (MLMD) for tracking metadata.
132- - ** Key Topics:**
133- - Metadata storage and querying
134- - Workflow lineage tracking
115+ - ** Sub-Labs:**
116+ - ** [ Lab1] ( ./Labs/MLMD_Labs/Lab1 ) :** Introduction to ML metadata concepts.
117+ - ** [ Lab2] ( ./Labs/MLMD_Labs/Lab2 ) :** Advanced usage and querying of ML metadata.
118+ - ** [ assets] ( ./Labs/MLMD_Labs/assets ) :** Supporting materials and assets for MLMD labs.
135119
13612013 . ** [ TensorFlow Labs] ( ./Labs/Tensorflow_Labs ) **
137121 - ** Objective:** Gain hands-on experience with TensorFlow for ML model development.
138- - ** Key Topics:**
139- - Model training and evaluation
140- - Using TFX for production-grade ML pipelines
122+ - ** Sub-Labs:**
123+ - ** [ TFDV Labs] ( ./Labs/Tensorflow_Labs/TFDV_Labs ) :** TensorFlow Data Validation labs.
124+ - ** [ TFDV TFX Installation] ( ./Labs/Tensorflow_Labs/TFDV_TFX_Installation ) :** Setting up TFX and TFDV.
125+ - ** [ TFT Labs] ( ./Labs/Tensorflow_Labs/TFT_Labs ) :** TensorFlow Transform labs.
126+ - ** [ TFX Labs] ( ./Labs/Tensorflow_Labs/TFX_Labs ) :** TensorFlow Extended for production pipelines.
141127
142128Each lab is accompanied by detailed instructions and code examples to facilitate hands-on learning. It's recommended to follow the labs sequentially, as concepts build upon each other. For additional resources and support, refer to the [ Reading Materials] ( ./Labs/Reading%20Materials ) section of this repository.
143129
0 commit comments