DC Field | Value | Language |
---|---|---|
dc.contributor.author | Lee, Jinho | - |
dc.contributor.author | HWANG, INSEOK | - |
dc.contributor.author | Shah, Soham | - |
dc.contributor.author | Cho, Minsik | - |
dc.date.accessioned | 2020-11-12T23:50:37Z | - |
dc.date.available | 2020-11-12T23:50:37Z | - |
dc.date.created | 2020-11-10 | - |
dc.date.issued | 2020-07-21 | - |
dc.identifier.uri | https://oasis.postech.ac.kr/handle/2014.oak/104285 | - |
dc.description.abstract | We propose FlexReduce, an efficient and flexible all-reduce algorithm for distributed deep learning under irregular network hierarchies. With ever-growing deep neural networks, distributed learning over multiple nodes is becoming imperative for expedited training. There are several approaches leveraging the symmetric network structure to optimize the performance over different hierarchy levels of the network. However, the assumption of symmetric network does not always hold, especially in shared cloud environments. By allocating an uneven portion of gradients to each learner (GPU), FlexReduce outperforms conventional algorithms on asymmetric network structures, and still performs even or better on symmetric networks. | - |
dc.publisher | ACM/IEEE | - |
dc.relation.isPartOf | DAC 2020 (57th ACM/IEEE Design Automation Conference) | - |
dc.relation.isPartOf | Proceedings of the 57th ACM/IEEE Design Automation Conference | - |
dc.title | FlexReduce: Flexible All-reduce for Distributed Deep Learning on Asymmetric Network Topology | - |
dc.type | Conference | - |
dc.type.rims | CONF | - |
dc.identifier.bibliographicCitation | DAC 2020 (57th ACM/IEEE Design Automation Conference) | - |
dc.citation.conferenceDate | 2020-07-20 | - |
dc.citation.conferencePlace | US | - |
dc.citation.title | DAC 2020 (57th ACM/IEEE Design Automation Conference) | - |
dc.contributor.affiliatedAuthor | HWANG, INSEOK | - |
dc.description.journalClass | 1 | - |
dc.description.journalClass | 1 | - |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.
library@postech.ac.kr Tel: 054-279-2548
Copyrights © by 2017 Pohang University of Science ad Technology All right reserved.