A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks – Learning Club talk by Asaf Noy

 Learning Club - Asaf Noy Title: A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks Abstract: Deep neural networks' remarkable ability to correctly fit training data when optimized by gradient-based algorithms is yet to be fully understood. Recent theoretical results explain the convergence for ReLU networks that are wider than those used in practice by ... Read more