‘Accelerate Everything,’ NVIDIA CEO Says Ahead of COMPUTEX

🌈 Abstract

The article discusses how generative AI is reshaping industries and opening new opportunities for innovation and growth. It highlights NVIDIA's role in driving the next wave of technological advancement through its innovations in AI and accelerated computing.

🙋 Q&A

[01] Generative AI and Accelerated Computing

1. What is the key message about the future of computing according to NVIDIA's CEO Jensen Huang?

• The future of computing is accelerated, with NVIDIA's innovations in AI and accelerated computing pushing the boundaries of what's possible and driving the next wave of technological advancement.
• Accelerated computing is sustainable computing, as the combination of GPUs and CPUs can deliver up to 100x speedup while only increasing power consumption by a factor of three, achieving 25x more performance per Watt over CPUs alone.

2. What are the key new semiconductor platforms and technologies that NVIDIA is introducing?

• NVIDIA is introducing a new semiconductor platform called Rubin, which will succeed the upcoming Blackwell platform and feature new GPUs, a new Arm-based CPU called Vera, and advanced networking with NVLink 6, CX9 SuperNIC, and the X1600 converged InfiniBand/Ethernet switch.
• NVIDIA is also unveiling plans for the annual release of Spectrum-X products to cater to the growing demand for high-performance Ethernet networking for AI.

[02] Transforming Industries with AI

1. How are leading computer manufacturers embracing NVIDIA's technologies?

• Top companies from Taiwan, the global IT hub, such as ASRock Rack, ASUS, GIGABYTE, Ingrasys, Inventec, Pegatron, QCT, Supermicro, Wistron, and Wiwynn, are creating cloud, on-premises, and edge AI systems using NVIDIA GPUs and networking solutions.

2. How is NVIDIA enabling the transformation of factories and warehouses with AI and robotics?

• NVIDIA's Isaac platform provides a robust toolkit for developers to build AI robots, including AMRs, industrial arms, and humanoids, powered by AI models and supercomputers like Jetson Orin and Thor.
• Global electronics giants are integrating NVIDIA's autonomous robotics into their factories, leveraging simulation in Omniverse to test and validate this new wave of AI for the physical world, with over 5 million preprogrammed robots worldwide.
• NVIDIA Isaac's advanced libraries and AI models are being adopted by leaders like BYD Electronics, Siemens, Teradyne Robotics, and Intrinsic to boost factory and warehouse efficiency.

[03] Democratizing Generative AI

1. How is NVIDIA making generative AI more accessible to developers?

• With NVIDIA NIM (inference microservices), the world's 28 million developers can now easily create generative AI applications, as NIM can be deployed on clouds, data centers, or workstations.
• NIM also enables enterprises to maximize their infrastructure investments, as running Meta Llama 3-8B in a NIM produces up to 3x more generative AI tokens on accelerated infrastructure than without NIM.
• Nearly 200 technology partners are integrating NIM into their platforms to speed up generative AI deployments for domain-specific applications.

2. How are NVIDIA and Microsoft collaborating to bring generative AI capabilities to Windows apps?

• Microsoft and NVIDIA are collaborating to help developers bring new generative AI capabilities to their Windows native and web apps with easy API access to RTX-accelerated SLMs that enable RAG capabilities that run on-device as part of Windows Copilot Runtime.