China’s optical chip breakthrough boosts AI speed 100-fold using fraction of compute power

AI Summary

Chinese researchers have developed an all-optical interconnect system for chips that improves AI inference speeds by over 100 times while using only a ninth of the usual computational power. This breakthrough may reduce energy demands and enhance AI applications industry-wide.

Chinese researchers have developed a new all-optical interconnect system linking standard electronic chips, boosting AI distributed inference speeds by over 100 times while using just one-ninth of the typical computational resources. As AI models permeate ever more applications, the industry’s appetite for computational power has grown insatiable. The conventional response has been to pile on more GPUs and build ever-larger data centres in a seemingly endless race for energy and brute force. But...