
UnspecifiedLearn from itLearning & data · Explainers & simulations
Follow one sentence through a tiny GPT, from tokens to next-word odds, computed live in the page
Inside a Transformer
Web · New
by Ashish Kumar
A step-by-step explainer runs a small two-block transformer in your browser and shows tokens, embeddings, attention, MLP and softmax for any sentence you type. The weights are untrained, so it explains the arithmetic rather than predicting well.
Notes
Maker's pages don't say how it was built. Untrained weights by design. Maker is identified on X and LinkedIn; personal site links to both.
Source checked 2026-10-16. Descriptions summarize the maker's own account, not independent testing.
Get one surprising agent build every morning.