Skip to content

Commit aba848b

Browse files
committed
docs: add Collabs README explaining Read/Explore/Build learning journey
1 parent 14301d4 commit aba848b

1 file changed

Lines changed: 74 additions & 0 deletions

File tree

collabs/README.md

Lines changed: 74 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,74 @@
1+
# Collabs
2+
3+
**Understanding the Interplay Between Algorithms and Systems**
4+
5+
> **Status:** Coming Summer 2026
6+
7+
---
8+
9+
## What Are Collabs?
10+
11+
Collabs are hands-on Google Colab simulations that bridge the gap between **reading about ML systems** (the textbook) and **building them from scratch** (TinyTorch).
12+
13+
```
14+
┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐
15+
│ │ │ │ │ │
16+
│ Textbook │────▶│ Collabs │────▶│ TinyTorch │
17+
│ │ │ │ │ │
18+
│ Concepts & │ │ Experiment & │ │ Build from │
19+
│ Theory │ │ Explore │ │ Scratch │
20+
│ │ │ │ │ │
21+
└─────────────────┘ └─────────────────┘ └─────────────────┘
22+
READ EXPLORE BUILD
23+
```
24+
25+
## The Learning Journey
26+
27+
| Phase | Resource | What You Do |
28+
|-------|----------|-------------|
29+
| **Understand** | [Textbook](https://mlsysbook.ai) | Learn concepts, theory, and system design principles |
30+
| **Experiment** | Collabs | Explore tradeoffs, tweak parameters, see how decisions ripple through systems |
31+
| **Build** | [TinyTorch](https://mlsysbook.ai/tinytorch) | Implement everything from scratch, own every line of code |
32+
33+
## Why Collabs?
34+
35+
ML systems are where algorithms meet hardware. A model that works perfectly in theory can fail in practice due to memory limits, latency constraints, or numerical precision. Collabs help you develop intuition for these algorithm-system interactions.
36+
37+
- **See the tradeoffs** — How does batch size affect memory? How does quantization affect accuracy?
38+
- **Explore interactively** — Adjust parameters and watch how changes ripple through the system
39+
- **Build intuition** — Understand *why* systems behave the way they do, not just *what* they do
40+
- **Zero setup** — Run directly in your browser via Google Colab
41+
42+
## Example Topics (Planned)
43+
44+
- **Memory vs. Compute Tradeoffs** — Watch how batch size affects memory footprint and training speed
45+
- **Quantization Effects** — See accuracy degradation as you reduce precision from FP32 → INT8 → INT4
46+
- **Attention Visualization** — Explore what transformer attention heads actually learn
47+
- **Optimization Landscapes** — Navigate loss surfaces with different optimizers
48+
- **Pruning Strategies** — Compare structured vs. unstructured pruning on real models
49+
50+
## Stay Updated
51+
52+
Collabs are under active development. To be notified when they launch:
53+
54+
- [Subscribe to updates](https://buttondown.email/mlsysbook)
55+
- [Star the repo](https://github.com/harvard-edge/cs249r_book)
56+
- [Join discussions](https://github.com/harvard-edge/cs249r_book/discussions)
57+
58+
---
59+
60+
## Related Resources
61+
62+
| Resource | Description |
63+
|----------|-------------|
64+
| [Textbook](https://mlsysbook.ai) | ML Systems principles and practices |
65+
| [TinyTorch](https://mlsysbook.ai/tinytorch) | Build your own ML framework from scratch |
66+
| [Discussions](https://github.com/harvard-edge/cs249r_book/discussions) | Ask questions, share feedback |
67+
68+
---
69+
70+
<div align="center">
71+
72+
**Read. Explore. Build.** *(Collabs coming soon)*
73+
74+
</div>

0 commit comments

Comments
 (0)