File tree Expand file tree Collapse file tree 1 file changed +7
-1
lines changed
Expand file tree Collapse file tree 1 file changed +7
-1
lines changed Original file line number Diff line number Diff line change 182182
183183- date : 4/1
184184 title : >
185- Week 9 <strong>Large models 1: Large Foundation Models</strong>
185+ Week 9 <strong>Large models 1: Large Foundation Models</strong> <a href="lec7 - large models.pdf">[slides]</a>
186186 slides :
187187 topics :
188188 - Pre-training data <br/>
189189 - Self-supervised learning <br/>
190190 - Fine-tuning, instructing, alignment
191191 readings :
192+ - <a href="https://arxiv.org/abs/2203.15556">Training Compute-Optimal Large Language Models</a> <br/>
193+ - ' <a href="https://arxiv.org/abs/2204.07705">Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks</a> <br/>'
194+ - ' <a href="https://arxiv.org/abs/2106.09685">LoRA: Low-Rank Adaptation of Large Language Models</a> <br/>'
195+ - ' <a href="https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-mixture-of-experts">A Visual Guide to Mixture of Experts (MoE)</a> <br/>'
196+ - ' <a href="https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-quantization">A Visual Guide to Quantization</a> <br/>'
197+ - ' <a href="https://arxiv.org/abs/2310.03744">Improved Baselines with Visual Instruction Tuning</a> <br/>'
192198
193199- date : 4/3
194200 title : >
You can’t perform that action at this time.
0 commit comments