We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Topology agnostic hot-spot avoidance with InfiniBand.
- Authors
Vishnu, Abhinav; Koop, Matthew; Moody, Adam; Mamidala, Amith; Narravula, Sundeep; Panda, Dhabaleswar K.
- Abstract
InfiniBand has become a very popular interconnect due to its advanced features and open standard. Large-scale InfiniBand clusters are becoming very popular, as reflected by the TOP 500 supercomputer rankings. However, even with popular topologies such as constant bi-section bandwidth Fat Tree, hot-spots may occur with InfiniBand due to inappropriate configuration of network paths, presence of other jobs in the network and un-availability of adaptive routing. In this paper, we present a hot-spot avoidance layer (HSAL) for InfiniBand, which provides hot-spot avoidance using path bandwidth estimation and multi-pathing using LMC mechanism, without taking the network topology into account. We propose an adaptive striping policy with batch-based striping and sorting approach, for efficient utilization of disjoint network paths. Integration of HSAL with MPI, the de facto programming model of clusters, shows promising results with collective communication primitives and MPI applications. Copyright © 2008 John Wiley & Sons, Ltd.
- Subjects
INFINIBAND (Standard); COMPUTER input-output equipment standards; NETWORK routers; ROUTING (Computer network management); COMPUTER software; SUPERCOMPUTERS; BANDWIDTHS
- Publication
Concurrency & Computation: Practice & Experience, 2009, Vol 21, Issue 3, p301
- ISSN
1532-0626
- Publication type
Article
- DOI
10.1002/cpe.1359