Improving Efficiency in Large-Scale Decentralized Distributed Training. - Zhang, Wei; Cui, Xiaodong; Kayi, Abdullah; Liu, Mingrui; Finkler, Ulrich; Kingsbury, Brian; Saon, George; Mroueh, Youssef; Buyuktosunoglu, Alper; Das, Payel; Kung, David S.; Picheny, Michael (CoRR, 2020)