GPU and ML systems
GPU and TPU architecture
How GPUs and TPUs run work: streaming multiprocessors and warps, the memory hierarchy, tensor cores and systolic arrays, and the roofline that compares compute with memory bandwidth. Kernel and serving performance follow from these limits.
Questions
Question Difficulty Success