What hardware is used for Deep Learning?

GPUs and TPUs are commonly used to accelerate the training of deep neural networks due to their parallel processing capabilities.