NOTE: I published a follow-up article with more up-to-date benchmark results here. For most of us, deep learning still happens on Nvidia GPUs. There is currently no alternative with practical relevance. Google’s Tensor Processing Unit (TPU), a custom-developed chip for deep learning, promises to change that. Nine months after the initial announcement, Google last week finally released TPUv2 to ear