GPU and ML systems
JAX and XLA
NumPy broadcasting and einsum, then JAX: pure functions transformed by jit, grad and vmap, compiled by XLA and sharded across devices. Google’s models and much of the research code that runs on TPUs are written this way.
Questions
Question Module Difficulty Success