| Wed, Jan 18 |
Introduction and Motivation (book chapter) |
|
|
| Fri, Jan 20 |
 Calling, securing, and creating APIs: Flask |
|
|
| Mon, Jan 23 |
From Models to AI-Enabled Systems (book chapter 1, chapter 2, chapter 3) |
Building Intelligent Systems, Ch. 4, 5, 7, 8 |
|
| Wed, Jan 25 |
Gathering and Untangling Requirements (book chapter) |
The World and the Machine |
|
| Fri, Jan 27 |
Stream processing: Apache Kafka |
|
|
| Mon, Jan 30 |
Planning for Mistakes (book chapter) |
Building Intelligent Systems, Ch. 6, 7, 24 |
I1: ML Product |
| Wed, Feb 01 |
Model Quality (book chapter 1, chapter 2) |
Building Intelligent Systems, Ch. 19 |
|
| Fri, Feb 03 |
Collaborating with GitHub: Pull requests, GitFlow, GitHub actions |
|
|
| Mon, Feb 06 |
Fostering Interdisciplinary (Student) Teams |
|
I2: Requirements |
| Wed, Feb 08 |
Model Testing Beyond Accuracy (book chapter) |
Behavioral Testing of NLP Models with CheckList |
|
| Fri, Feb 10 |
Collaboration tools: Jira, Miro, Slack, ... |
|
|
| Mon, Feb 13 |
Toward Architecture and Design (book chapter 1, chapter 2, chapter 3) |
Building Intelligent Systems, Ch. 18 & Choosing the right ML alg. |
|
| Wed, Feb 15 |
Model Deployment (book chapter) |
Building Intelligent Systems, Ch. 13 and Machine Learning Design Patterns, Ch. 16 |
|
| Fri, Feb 17 |
Containers: Docker |
|
|
| Mon, Feb 20 |
Testing in Production (book chapter) |
Building Intelligent Systems, Ch. 14, 15 |
M1: Modeling and First Deployment |
| Wed, Feb 22 |
Data Quality (book chapter) |
Data Cascades in High-Stakes AI |
|
| Fri, Feb 24 |
Model Testing: Zeno and AdaTest |
|
|
| Mon, Feb 27 |
Automating and Testing ML Pipelines (book chapter 1, chapter 2, chapter 3) |
The ML Test Score |
I3: Architecture |
| Wed, Mar 01 |
 Midterm |
|
|
| Fri, Mar 03 |
Continuous Integration: Jenkins |
|
|
| Mon, Mar 06 |
 Spring break, no classes |
|
|
| Wed, Mar 08 |
Spring break, no classes |
|
|
| Fri, Mar 10 |
Spring break, no classes |
|
|
| Mon, Mar 13 |
Scaling Data Storage and Data Processing (book chapter) |
Big Data, Ch. 1 |
|
| Wed, Mar 15 |
Planning for Operations (chapter) |
Operationalizing Machine Learning |
|
| Fri, Mar 17 |
Pipeline automation: MLFlow |
|
|
| Mon, Mar 20 |
Process & Technical Debt (book chapter 1, chapter 2) |
Hidden Technical Debt in Machine Learning Systems |
|
| Wed, Mar 22 |
Intro to Ethics + Fairness (book chapter 1, chapter 2) |
Algorithmic Accountability: A Primer |
|
| Fri, Mar 24 |
Monitoring: Prometheus, Grafana |
|
|
| Mon, Mar 27 |
Measuring Fairness (book chapter) |
Human Perceptions of Fairness in Algorithmic Decision Making |
M2: Infrastructure Quality |
| Wed, Mar 29 |
Building Fairer Systems (book chapter) |
Improving Fairness in Machine Learning Systems |
|
| Fri, Mar 31 |
Container Orchestration: Kubernetis |
|
|
| Mon, Apr 03 |
Explainability & Interpretability (book chapter) |
Black boxes not required or Stop Explaining Black Box ML Models… |
I4: Open Source Tools |
| Wed, Apr 05 |
Transparency & Accountability (book chapter) |
People + AI, Ch. Explainability and Trust |
|
| Fri, Apr 07 |
Fairness Toolkits |
|
|
| Mon, Apr 10 |
Versioning, Provenance, and Reproducability (book chapter) |
|
|
| Wed, Apr 12 |
Safety (book chapter) |
|
|
| Fri, Apr 14 |
Spring Carnival, no classes |
|
|
| Mon, Apr 17 |
Security and Privacy (book chapter) |
|
|
| Wed, Apr 19 |
More Safety, Security, and Privacy (tbd) |
|
M3: Monitoring and CD |
| Fri, Apr 21 |
Model Explainability Tools |
|
|
| Mon, Apr 24 |
Fostering Interdisciplinary Teams (book chapter) |
Collaboration Challenges in Building ML-Enabled Systems |
|
| Wed, Apr 26 |
Summary and Review |
|
M4: Fairness, Security and Feedback Loops |
| Thu, May 4 05:30-08:30pm |
Final Project Presentations |
|
Final report |
