When it comes to using GPUs for deep learning, I usually use Google Colab (80% of the time) or for when I need something more persistent, Google's Compute Engine running a deep learning virtual machine (VM). Colab usually suffices for short-to-medium size experiments but when you need to step things