Learning-LLMs

I am learning to build LLMs from scratch. Here are some stuffs 'm sharing just to keep it documented.

Name		Name	Last commit message	Last commit date
Latest commit History 17 Commits
A_GPT_MODEL_FROM_SCRATCH.ipynb		A_GPT_MODEL_FROM_SCRATCH.ipynb
Controlling_Randomness.ipynb		Controlling_Randomness.ipynb
Controlling_Randomness_Temperature_Scaling_+_Top_K_Sampling.ipynb		Controlling_Randomness_Temperature_Scaling_+_Top_K_Sampling.ipynb
Input target pairs.ipynb		Input target pairs.ipynb
Instruction_based_question_answering_demo.ipynb		Instruction_based_question_answering_demo.ipynb
Intro to LLM tokenizer.ipynb		Intro to LLM tokenizer.ipynb
LICENSE		LICENSE
LLM_Pre_training_Loop.ipynb		LLM_Pre_training_Loop.ipynb
LOADING_PRETRAINED_WEIGHTS_FROM_OPENAI_AND_USING_.ipynb		LOADING_PRETRAINED_WEIGHTS_FROM_OPENAI_AND_USING_.ipynb
README.md		README.md
SPAM_CLASSIFIER.ipynb		SPAM_CLASSIFIER.ipynb
Vector_embedding_demo.ipynb		Vector_embedding_demo.ipynb
byte pair encoding.ipynb		byte pair encoding.ipynb
implementing_a_simple_attention_mechanism.ipynb		implementing_a_simple_attention_mechanism.ipynb
masked_and_multi_head_attention_mechanism.ipynb		masked_and_multi_head_attention_mechanism.ipynb
token embeddings.ipynb		token embeddings.ipynb

Provide feedback