File tree Expand file tree Collapse file tree
presentation_final/sections Expand file tree Collapse file tree Original file line number Diff line number Diff line change 1212
1313 \vspace {0.2cm}
1414 \item \textbf {Comprehensive empirical study } covering 2~SOTA models
15- (DeepSeek~V3, Kimi~K2) $ \times $ 5~grid regions $ \times $ 4~years of replay data
15+ (DeepSeek~V3, Kimi~K2) $ \times $ 5~grid regions of replay data
1616 --- the first systematic Pareto frontiers for carbon-aware LLM training.
1717
1818 \vspace {0.2cm}
Original file line number Diff line number Diff line change 1- \begin {frame }[t]{Project Objectives}{What will the simulation answer?}
2- \textbf {Obligatory: }
1+ \begin {frame }[t]{Research Questions}{What do we want to answer?}
32 \begin {itemize }
43 \item \textbf {Carbon Intensity \& Temporal Trade-offs }\\
5- Quantify how CO$ _2 $ savings depend on the pause threshold
6- (gCO$ _2 $ eq/kWh) versus added training time
7- $ \Rightarrow $ Pareto frontier for carbon-aware scheduling.
8- \item \textbf {Impact Assessment on SOTA Architectures }\\
9- Benchmark absolute and relative CO$ _2 $ reduction potential for
10- different large models (e.g.\ DeepSeek V3, Kimi K2).
11- \end {itemize }
12-
13- \vspace {0.3cm}
14- \textbf {Wishful: }
15- \begin {itemize }
4+ How much CO$ _2 $ eq can be saved by dynamically pausing the
5+ pretraining when CO2 intensity is high and how much training
6+ time is added?
167 \item \textbf {Spatiotemporal Selection }\\
17- Identify favourable \emph {time windows } and \emph {seasons }
8+ What are the favourable \emph {time windows } and \emph {seasons }
189 to run training in a given region.
1910 \item \textbf {Geospatial Grid Analysis }\\
20- Compare regions to find the most sustainable locations
21- for pretraining, given their grid mix.
22- \end {itemize }
23-
24- \vspace {0.3cm}
25- \textbf {Optional: }
26- \begin {itemize }
27- \item \textbf {Computational Granularity \& Resumption Logic }\\
28- Study how checkpoint frequency (batch vs.\ epoch, etc.)
29- impacts the trade-off between CO$ _2 $ savings and overhead.
11+ What region provides the best carbon savings for the pretraining of a given model?
3012 \end {itemize }
3113
3214\end {frame }
Original file line number Diff line number Diff line change 11\subsection {Specification }
22
3- \begin {frame }[t]{Parameters I }{}
3+ \begin {frame }[t]{Parameters}{}
44
55 \small
66
Original file line number Diff line number Diff line change @@ -106,7 +106,7 @@ \subsection{Threshold Space Analysis}
106106
107107 \vspace {0.2cm}
108108 \begin {alertblock }{Central finding}
109- $ \theta _p - \theta _r < 16 $ ~gCO$ _2 $ eq/kWh \textbf {in every region and model }.
109+ $ \theta _p - \theta _r \leq 16 $ ~gCO$ _2 $ eq/kWh \textbf {in every region and model }.
110110 Wide hysteresis degrades the savings-to-overhead ratio.
111111 \end {alertblock }
112112
Original file line number Diff line number Diff line change 1414 \vspace {0.2cm}
1515 \begin {alertblock }{Central finding}
1616 The optimal hysteresis margin is consistently narrow
17- ($ \theta _p - \theta _r < 16 $ ~gCO$ _2 $ eq/kWh).
17+ ($ \theta _p - \theta _r \leq 16 $ ~gCO$ _2 $ eq/kWh).
1818 Wide hysteresis \textbf {never } Pareto-optimal.
1919 Pausing is a binary clean/dirty decision, not a multi-level filter.
2020 \end {alertblock }
You can’t perform that action at this time.
0 commit comments