Scalable Learning to Optimize: A Learned Optimizer Can Train Big Models

von Chen, Xuxi
Veröffentlicht in ECCV (17. : 2022 : Tel Aviv; Online) Computer vision – ECCV 2022 ; Part 23 (2022)

POOLINGFORMER: LONG DOCUMENT MODELING WITH POOLING ATTENTION

von ZHANG, HANG
Veröffentlicht in International Conference on Machine Learning (38. : 2021 : Online) International Conference on Machine Learning (ICML 2021 ; Part 16 of 16 (2022)

PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance

von Zhang, Qingru
Veröffentlicht in International Conference on Machine Learning (39. : 2022 : Baltimore, Md.; Online) International Conference on Machine Learning (ICML 2022) ; Part 32 of 33 (2023)

Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer

von Yang, Ge
Veröffentlicht in NeurIPS (35. : 2021 : Online) 35th Conference on Neural Information Processing Systems (NeurIPS 2021) ; Volume 21 of 36 (2022)

BANG: BRIDGING AUTOREGRESSIVE AND NON-AUTOREGRESSIVE GENERATION WITH LARGE SCALE PRETRAINING

von QI, WEIZHEN
Veröffentlicht in International Conference on Machine Learning (38. : 2021 : Online) International Conference on Machine Learning (ICML 2021 ; Part 11 of 16 (2022)