Networking is becoming more critical to the development of frontier model intelligence. Moore’s Law is slowing, which means individual chip improvements through transistor shrinkage are slowing. Further advances in frontier models require greater computing power, making other approaches to improving performance increasingly important. Connecting chips together more efficiently is becoming a more important source of computing power. Training and inferencing clusters — the large networks of chips used to build AI models and deliver AI services to users — continue to grow in size, increasing the importance of networking infrastructure.
As a result of these trends, we believe networking should grow faster than computing power for the foreseeable future, aided by the compounding effect. Each incremental accelerator added to a cluster generates traffic in a superlinear way — that is, the ratio of switches to accelerators goes up faster than 1:1. For 32 accelerators, you only need 12 switches. For 128 accelerators, you need 80 switches.
In addition, faster networking requires more expensive switches, providing a tailwind to pricing. Third-party estimates project AI networking spend to reach $200 to $250 billion by 2030, up from $50 billion today. The Bessemer equity teams have exposure to networking through positions in Broadcom (AVGO), Nvidia (NVDA), and Cisco (CSCO).
Within networking, there are three primary categories: scale-across, which connects data centers; scale-out, which connects server racks within data centers; and scale-up, which connects accelerators within server racks. In scale-up, copper has been the default due to its reliability, cost, and power efficiency, but it is not ideal for longer distances or higher speeds due to physical limitations. Once you go beyond a certain distance and/or bandwidth/latency requirement, optical connectivity becomes increasingly necessary. Bessemer believes this shift toward optical connectivity will be an increasingly important trend over time. The equity teams have exposure to this trend through companies such as Applied Optoelectronics (AAOI), Credo (CRDO), and MACOM Technology (MTSI).