GPU and ML systems 0/0

GPU and ML systems

JAX and XLA

NumPy broadcasting and einsum, then JAX: pure functions transformed by jit, grad and vmap, compiled by XLA and sharded across devices. Google’s models and much of the research code that runs on TPUs are written this way.

0 / 14 solved