Skip to content

Commit

Permalink
Build LLM from scratch tutorial
Browse files Browse the repository at this point in the history
  • Loading branch information
ritchieng committed Jan 2, 2024
1 parent e8f286b commit 52c31b9
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -108,9 +108,11 @@ This is a curated list of tutorials, projects, libraries, videos, papers, books
- [Semantic Search with PyTorch](https://github.com/kuutsav/information-retrieval)

## <a name='LargeLanguageModels'></a>Large Language Models (LLMs)
- LLM Tutorials
- [Build a Large Language Model (From Scratch)](https://github.com/rasbt/LLMs-from-scratch)
- [Hugginface LLM Training Book, a collection of methodologies to help with successful training of large language models](https://github.com/huggingface/llm_training_handbook)
- General
- [GPT Fast, fast and hackable pytorch native transformer inference](https://github.com/pytorch-labs/gpt-fast)
- [Hugginface LLM Training Book, a collection of methodologies to help with successful training of large language models](https://github.com/huggingface/llm_training_handbook)
- [Llama](https://github.com/facebookresearch/llama)
- [TinyLlama](https://github.com/jzhang38/TinyLlama)
- [Mosaic Pretrained Transformers (MPT)](https://github.com/mosaicml/llm-foundry)
Expand Down

0 comments on commit 52c31b9

Please sign in to comment.