Directions in ML: AutoML and Automating Algorithms

March 24, 2021 | Misha Khodak, Neil Tenenholtz, Lester Mackey, and Nicolo Fusi

From BiT (928 million parameters (opens in new tab)) to GPT-3 (175 billion parameters (opens in new tab)), state-of-the-art machine learning models are rapidly growing in size. With the greater expressivity and easier trainability of these models come skyrocketing training…

December 17, 2020

Microsoft researchers pursue the big questions about what the world will be like in the future and the role technology will play. Not only do they take on the responsibility of exploring the long-term vision of their research, but they…