How did ML get fixated on the idea of using the same step size for every example? This is bad if your data has fat tails. For Cauchy-distributed data, SGD fails to converge for every setting of step-size and batch-size colab.research.google.com/drive/1KQQGJvJ…