A GPU — Graphics Processing Unit — is a chip built to do thousands of simple calculations at the exact same time. Originally designed to render video game graphics (every pixel on screen, every frame), researchers discovered it was also perfect for AI. Training an AI model is basically the same type of math — repeated billions of times in parallel.
GPU = thousands of small cores doing the same simple task simultaneously. Perfect for AI.