What is Microsoft Research's µ-Parametrization?
µTransfer: A technique for hyperparameter tuning of enormous neural networks
Microsoft Research has done it again! This is pretty exciting for OpenAI. There’s some suggestion that Microsoft and OpenAI may have solved a fundamental AI bottleneck. So let’s get into it.
The rese…
