AI Supremacy

AI Supremacy

Share this post

AI Supremacy
AI Supremacy
What is Microsoft Research's µ-Parametrization?
Copy link
Facebook
Email
Notes
More

What is Microsoft Research's µ-Parametrization?

µTransfer: A technique for hyperparameter tuning of enormous neural networks

Michael Spencer's avatar
Michael Spencer
Mar 11, 2022
∙ Paid
2

Share this post

AI Supremacy
AI Supremacy
What is Microsoft Research's µ-Parametrization?
Copy link
Facebook
Email
Notes
More
Share

Microsoft Research has done it again! This is pretty exciting for OpenAI. There’s some suggestion that Microsoft and OpenAI may have solved a fundamental AI bottleneck. So let’s get into it.

The rese…

Keep reading with a 7-day free trial

Subscribe to AI Supremacy to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Michael Spencer
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share

Copy link
Facebook
Email
Notes
More