GSAS: How to train your network

How do you train an infinite neural network? I will show the dynamics of gradient descent optimization in the over-parameterized limit, with the application to infinite-width neural networks. I will show how to unify the two standard approaches to infinite NN: mean-field limit and neural tangent kernel. Get your functional analysis muscles warmed up, because they will do some heavy lifting!