PWW

Portfolio AI Insights

pww.comNVIDIA Corporation Presents at BofA Securities 2024 Global Technology Conference, Jun-05-2024 12:30 PM - NasdaqGS:NVDA

NasdaqGS:NVDA

Ian Buck [Vice President of Accelerated Computing Business Unit] 💬

**- Computex Announcements: Ian Buck discussed NVIDIA's Computex announcements, highlighting the importance of the MGX system standard for deploying GPU systems. He also covered the upcoming Blackwell and Rubin platforms, emphasizing advancements in both hardware and software.

  • Hyperscaler Market: Buck explained the three main thrusts of hyperscalers: providing scalable infrastructure, token serving for AI inference, and building next-generation models. He noted that these activities are highly profitable, with significant ROI for cloud providers.

  • AI Model Evolution: Buck discussed the rapid evolution of AI models, from image recognition to language models and generative AI. He emphasized that models are continually growing in size and complexity, with no immediate signs of reaching a peak.

  • Product Cadence: Buck addressed the 1-year product cadence, explaining that continuous improvements in hardware, connectivity, algorithms, and model architecture are essential. He highlighted the importance of maintaining a balance between rapid innovation and customer data center management.

  • Inference vs. Training: Buck noted that the same infrastructure is increasingly being used for both inference and training, which provides flexibility and maximizes ROI for customers.

  • CUDA and Moat: Buck defended CUDA, stating that its widespread adoption and the ecosystem built around it provide a strong foundation for future AI innovations.

  • Blackwell Outlook: Buck discussed the challenges and opportunities with Blackwell, including the transition to denser and more power-efficient computing, the use of liquid cooling, and the need for advanced cooling technologies.

  • Data Center Strategies: Buck explained that customers are both building new data centers and decommissioning old CPU infrastructure to make room for more GPUs.

  • Networking Strategy: Buck outlined NVIDIA's strategy with Spectrum-X, which aims to provide a standard Ethernet solution optimized for AI's east-west traffic, complementing the existing InfiniBand offerings.**

Feedback