NVIDIA CEO Jensen Huang used the keynote opening deal with at Taiwan’s Computex 2024 occasion to unveil next-gen tech and the roadmap the corporate will pursue to grow to be the main AI {hardware} platform.
The theme of his deal with was “Speed up all the things” and Huang unveiled new chips, sooner AI networking, and an formidable improvement roadmap. From AI PCs to large AI factories, NVIDIA desires to be the enabler of what comes subsequent with AI.
“The way forward for computing is accelerated,” Huang mentioned. “With our improvements in AI and accelerated computing, we’re pushing the boundaries of what’s doable and driving the subsequent wave of technological development.”
Right here’s a fast take a look at a few of the bulletins:
New chips
The Blackwell GPUs are scorching off the manufacturing line however Huang says we will already anticipate an upgraded Blackwell Extremely GPU later this 12 months. He mentioned that NVIDIA’s improvement roadmap will see a brand new household of chips launched yearly.
“Our firm has a one-year rhythm. Our fundamental philosophy could be very easy: construct all the knowledge heart scale, disaggregate and promote to you components on a one-year rhythm, and push all the things to expertise limits,” Huang defined.
Huang introduced that 2026 will see its Rubin platform succeed the Blackwell household of GPUs.
AI factories
Huang named a number of computing corporations that can construct “AI factories” that can ship cloud, on-premises, embedded, and edge AI methods utilizing NVIDIA GPUs and networking.
Huang mentioned, “The subsequent industrial revolution has begun. Corporations and nations are partnering with NVIDIA to shift the trillion-dollar conventional knowledge facilities to accelerated computing and construct a brand new sort of knowledge heart — AI factories — to provide a brand new commodity: synthetic intelligence.”
NVIDIA MGX (Modular Server Reference Structure) is a blueprint for constructing knowledge heart servers that focuses on accelerated computing. It makes use of a standardized strategy for constructing servers utilizing NVIDIA merchandise, which makes it loads simpler for these AI factories to be constructed.
NVIDIA Spectrum-X
NVIDIA makes use of NVLink to maneuver knowledge between GPUs, however shifting knowledge between GPU pods inside or between knowledge facilities presents an extra problem.
NVIDIA Spectrum-X is the world’s first Ethernet networking platform particularly designed to boost the efficiency of AI workloads. Naturally, NVIDIA Spectrum-X is optimized for NVIDIA’s {hardware}.
NVIDIA says Spectrum-X accelerates generative AI community efficiency by 1.6x over conventional Ethernet materials.
Final week we reported that Huge Tech computing corporations are working to develop an open accelerated AI networking normal with out NVIDIA’s enter.
Even so, Huang mentioned Spectrum-X is already being adopted by corporations like Dell Applied sciences, Hewlett Packard Enterprise, and Lenovo.
NIM
NVIDIA NIM, which stands for NVIDIA Inference Microservices, is a set of instruments designed to simplify and speed up the deployment of generative AI fashions.
Earlier than you need to use an AI mannequin, builders have to deploy it. As an alternative of getting to tinker with the nuts and bolts of that course of, NVIDIA NIMs simplify deployment by routinely containerizing AI fashions and optimizing them for NVIDIA {hardware}.
It’s just like the distinction between shopping for chopping, and assembling all of the elements for a meal versus popping a readymade meal within the oven.
Huang introduced that the Llama 3 NIM was now accessible as a free obtain for builders to check out. Huang additionally unveiled Nvidia Ace NIMs which features a Digital Human mannequin able to producing AI human fashions with lifelike pores and skin.
You’ll be able to watch the complete keynote deal with to see extra particulars on AI RTX-powered PCs and laptops, Nividia’s Isaac ROS 3.0 robotics platform, and the way factories are utilizing NVIDIA’s tech to create digital twins on their factories to coach robots.