Everything going on in AI - updated daily from 500+ sources
Marvell announces 102.4 Tbps switch silicon built for AI
Marvell Technology says its newly unveiled Teralynx T100 is the industry’s first 102.4 Tbps switch silicon purpose-built for AI. The Teralynx T100 was architected for AI, with low power consumption and low latency at this bandwidth tier, to address critical bottlenecks in today’s large clusters. Data movement has become an important concern in modern AI data centers. In the past, a cluster of a few servers could adequately handle back-office applications and databases. But with AI’s gigantic models, all sections of the data center need to move and receive data at high speeds. That requires a lot more power use than in the past. GPU- and XPU-based systems are approaching 120KW per rack, and switching and networking components consume approximately 15-25% of total rack power, making low-power switch silicon a strategic requirement. The Teralynx T100 delivers up to 25% lower power consumption than competitive solutions at a higher data rate. This enables AI infrastructures to deploy more accelerators within existing power envelopes without requiring additional power infrastructure. “As AI workloads evolve and scale exponentially, hyperscalers require network architectures that optimize latency, power and scalability simultaneously,” said Rishi Chugh, vice president and general manager of the data center switch business unit at Marvell, in a statement. “The Teralynx T100 was purpose-built for AI—designed without the legacy baggage that inflates power, and engineered to deliver the deterministic performance and efficiency required to scale next-generation data center infrastructure.” For scale-out deployments, the T100 supports up to a 512-port radix, enabling operators to consolidate network tiers, simplify architectures, and reduce latency across large AI training clusters with tens of thousands of accelerators. For scale-up deployments, the product’s flexible and programmable pipeline architecture supports a variety of interconnect standards and emerging scale-up fabric protocols, such as the Ethernet Scale-Up Networking (ESUN) protocol, the latest Ultra Ethernet Consortium (UEC) requirements, and evolving AI Ethernet fabrics. The Marvell Teralynx T100 switch will begin sampling to customers this quarter.
Read Original Article →