Momentum Centering and Asynchronous Update for Adaptive Gradient Methods

von Zhuang, Juntang
Veröffentlicht in NeurIPS (35. : 2021 : Online) 35th Conference on Neural Information Processing Systems (NeurIPS 2021) ; Volume 34 of 36 (2022)

ADABELIEF OPTIMIZER: ADAPTING STEPSIZES BY THE BELIEF IN OBSERVED GRADIENTS

von Zhuang, Juntang
Veröffentlicht in NeurIPS (34. : 2020 : Online) 34th Conference on Neural Information Processing Systems (NeurIPS 2020) ; Volume 23 of 27 (2021)