tinyGPT

A from-scratch, CPU-first GPT built to work as an offline AI lab assistant. Every layer is hand-written in PyTorch — attention maths, causal masking, positional encoding, and the training and validation loop — rather than calling a library abstraction. Built for a research project that needed a usable assistant on a plane: no network, no GPU, no API.

2026