Scatterbrain: Unifying Sparse and Low-rank Attention

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:NeurIPS (35. : 2021 : Online) 35th Conference on Neural Information Processing Systems (NeurIPS 2021) ; Volume 21 of 36
1. Verfasser: Chen, Beidi (VerfasserIn)
Weitere Verfasser: Dao, Tri (VerfasserIn), Winsor, Eric (VerfasserIn), Song, Zhao (VerfasserIn), Rudra, Atri (VerfasserIn), Ré, Christopher (VerfasserIn)
Pages:35
Format: UnknownFormat
Sprache:eng
Veröffentlicht: 2022
Schlagworte:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Titel Jahr Verfasser
Neural Rule-Execution Tracking Machine For Transformer-Based Text Generation 2022 Wang, Yufei
Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence 2022 Labatie, Antoine
On the Representation Power of Set Pooling Networks 2022 Bueno, Christian
Discerning Decision-Making Process of Deep Neural Networks with Hierarchical Voting Transformation 2022 Sun, Ying
Risk-averse Heteroscedastic Bayesian Optimization 2022 Makarova, Anastasia
Provably Strict Generalisation Benefit for Invariance in Kernel Methods 2022 Elesedy, Bryn
Topological Detection of Trojaned Neural Networks 2022 Zheng, Songzhu
Understanding the Limits of Unsupervised Domain Adaptation via Data Poisoning 2022 Mehra, Akshay
Boosting with Multiple Sources 2022 Cortes, Corinna
Coresets for Clustering with Missing Values 2022 Braverman, Vladimir
Scatterbrain: Unifying Sparse and Low-rank Attention 2022 Chen, Beidi
Differentially Private Learning with Adaptive Clipping 2022 Andrew, Galen
Hash Layers For Large Sparse Models 2022 Roller, Stephen
Regret Minimization Experience Replay in Off-Policy Reinforcement Learning 2022 Liu, Xu-Hui
Deep Bandits Show-Off: Simple and Efficient Exploration with Deep Networks 2022 Zhu, Rong
An Information-theoretic Approach to Distribution Shifts 2022 Federici, Marco
Structure-Aware Random Fourier Kernel for Graphs 2022 Fang, Jinyuan
Improving Transferability of Representations via Augmentation-Aware Self-Supervision 2022 Lee, Hankook
The Implicit Bias of Minima Stability: A View from Function Space 2022 Mulayoff, Rotem
Robust Auction Design in the Auto-bidding World 2022 Balseiro, Santiago
Alle Artikel auflisten