GPU

GPUs are massively parallel processors originally designed for graphics rendering that have become the primary hardware for training and running AI models. Their thousands of cores execute matrix multiplications — the dominant operation in neural networks — far faster than CPUs.

NVIDIA H100 and A100 GPUs are the workhorses of LLM training, while consumer GPUs like the RTX 4090 enable local inference.