Repository:w3cj/how-llms-work
How LLMs Work: An Interactive Step-by-Step Guide to Language Model Mechanics
The GitHub repository 'how-llms-work' by w3cj provides an interactive web application that explains the inner mechanics of large language models step by step. From pattern-matching chatbots to neural network backpropagation, BPE tokenisation, Word2Vec embeddings, and training a transformer from scratch, each stage includes locally runnable code.
568starsTypeScript
From Video: Building an LLM from Scratch: Neural Networks, Tokenization, and Transformers