Publications of Torsten Hoefler

Torsten Hoefler:

Towards smart(er) High-Performance Networking Driving Future Simulations

(Presentation - presented in Seattla, WA, USA, Aug. 2023)
Invited talk at the MODSIM'23 workshop

Abstract

The network has traditionally been the most crucialcomponent of large-scale high-performance computers (HPC) and more recently datacenters and AI training clusters. HPC networking has always relied on specialized solutions specifically designed for particular systems, such as the Cray interconnects series including Gemini, Aries, Slinghot, or NVIDIA's InfiniBand interconnect. On the other hand, Ethernet has long been the elephant in the room for connecting datacenter machines. The current shift towards hyperscale datacenters and AI supercomputers in the cloud is generating a demand for network performance that surpasses traditional HPC deployments. In this context, we predict that future networks will emerge through a convergence of HPC network technologies and Ethernet. We examine various deployment models and discuss the limitations of RDMA (Remote Direct Memory Access). Subsequently, we present the concept of smart networks that can integrate RDMA accesses, protocol processing, and computations within the network card, thereby unifying these functionalities. Our vision of 'streaming processing in the network' aligns with CUDA's role in accelerating networking tasks. Finally, we provide a glimpse into the future, envisioning a converged interconnect for datacenter and HPC networking.

Documents

download slides:

BibTeX

@misc{hoefler-modsim23,
  author={Torsten Hoefler},
  title={{Towards smart(er) High-Performance Networking Driving Future Simulations}},
  year={2023},
  month={Aug.},
  location={Seattla, WA, USA},
  source={http://www.unixer.de/~htor/publications/},
}


serving: 3.23.103.14:30792	© Torsten Hoefler