VentureBeat

Nvidia Megatron: Not a robot in disguise, but a large language model that’s getting faster

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now In the fictional Transformers universe, ...
insideHPC

Video Highlights: Ultimate Guide To Scaling ML Models – Megatron-LM | ZeRO | DeepSpeed | Mixed Precision

In this video presentation, Aleksa Gordić explains what it takes to scale ML models up to trillions of parameters! He covers the fundamental ideas behind all of the recent big ML models like Meta’s ...
VentureBeat

Microsoft and Nvidia team up to train one of the world’s largest language models

Want smarter insights in your inbox? Sign up for our weekly newsletters to get only what matters to enterprise AI, data, and security leaders. Subscribe Now Microsoft and Nvidia today announced that ...
Windows Central

Megatron gets a tune-up courtesy of Microsoft and NVIDIA

Megatron-Turing NLG 530B is a language model. Microsoft and NVIDIA teamed up to train it and make it the largest, most powerful AI language model. The companies admit their work is nowhere near ...
TechSpot

Microsoft and Nvidia created the world's largest, most powerful language model to date, but it's still biased

In context: The costs associated with AI model training have dropped more than 100 times between 2017 and 2019, yet they remain prohibitive for most startups to this day. This naturally favors large ...