Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be. - Kunstner, Frederik; Chen, Jacques; Lavington, Jonathan Wilder; Schmidt, Mark (CoRR, 2023)