Huang Renxun and Marvell CEO Discuss on Stage: The Future of AI Competition is Not Computing Power but Connectivity, 'Use Copper Where You Can, Use Optics Only Where You Must'
Summary: At Computex 2024, NVIDIA CEO Jensen Huang joined Marvell CEO Matt Murphy on stage, highlighting the strategic partnership between their companies. The core theme was that the next decisive battleground for AI infrastructure is not compute or memory, but connectivity. As AI models evolve into vast agent-based systems, the ability to connect millions of processors efficiently is becoming the critical bottleneck. Huang announced NVIDIA's strategic $20 billion investment in Marvell, reflecting the deep integration between their technologies for AI data centers.
A key discussion point was the transition from copper to optical interconnects within racks. The guiding principle, articulated by Huang, is: "You use optics wherever you must, you use copper wherever you can." While copper remains cost-effective for short distances, its physical limits are being reached as bandwidth demands double. When moving to 400Gbps, copper can no longer fully connect an entire rack. This shift necessitates innovations like Co-Packaged Optics (CPO), which integrates optical engines directly into the chip package to solve density and power challenges. Marvell demonstrated its 51.2T CPO-based switch, eliminating copper traces on the PCB.
The future vision is a "distance-free data center," where optical connectivity removes physical constraints. This allows for fully disaggregated, dynamic architectures where compute, memory, and storage pools can be combined on-demand based on workload requirements, rather than being limited by connection boundaries. Marvell, positioned as a neutral "Switzerland" in the ecosystem with a comprehensive portfolio across all connectivity distances, is central to enabling this next era of AI infrastructure.
marsbitIeri 09:41
