Nvidia and Microsoft are constructing an AI supercomputer

Nvidia has announced a “multi-year collaboration” with Microsoft to construct “one of the most powerful AI supercomputers in the world,” designed to deal with the large computing workloads wanted to coach and scale AI. The collaboration will see Nvidia using Microsoft’s scalable digital machine situations to speed up advances in generative AI fashions like DALL-E. 

Based on Microsoft’s Azure cloud infrastructure, the AI supercomputer will use tens of 1000’s of Nvidia’s highly effective H100 and A100 knowledge heart GPUs and its Quantum-2 InfiniBand networking platform. According to Nvidia, the mix of Microsoft’s Azure cloud platform and Nvidia’s GPUs, networking, and full AI suite will permit extra enterprises to coach, deploy, and scale AI — together with massive, state-of-the-art fashions. The two corporations can even collaboratively develop DeepSpeed, Microsoft’s deep studying optimization software program.

In a statement, Nvidia stated the supercomputer might be used to “research and further accelerate advances in generative AI,” a comparatively new class of huge language fashions like DALL-E and Stable Diffusion that use self-learning algorithms to create a various vary of content material, comparable to textual content, code, digital pictures, video, and audio. These AI fashions have seen speedy development in recent times which has considerably raised the demand for highly effective computing infrastructure able to scaling alongside their growth.

“AI technology advances as well as industry adoption are accelerating. The breakthrough of foundation models has triggered a tidal wave of research, fostered new startups and enabled new enterprise applications,” stated Nvidia vice chairman of enterprise computing Manuvir Das. “Our collaboration with Microsoft will provide researchers and companies with state-of-the-art AI infrastructure and software to capitalize on the transformative power of AI.”