Relevance of Latency in Ethernet Networking for AI Infrastructure
Konferenz: ECOC 2024 - 50th European Conference on Optical Communication
22.09.2024-26.09.2024 in Frankfurt, Germany
Tagungsband: ITG-Fb. 317: ECOC 2024
Seiten: 4Sprache: EnglischTyp: PDF
Autoren:
Mi, Guangcan; He, Xiang; Zheng, Xiaolong
Inhalt:
We broke down the Ethernet link latency, investigated its impact to AI training time by simulating an 8192-server AI cluster network, showing less than 0.01% performance degradation for 20 mus of added link latency. The result was verified in a real-world testbed.