Introducing Feedback Connections for Vision Transformers

This work proposes a Adaptive Gated Attention Block which adds lightweight top-down and bottom-up connections to enhance information flow be-tween features at different levels and consistently outperforms existing state-of-the-art with a negligible increase in parameters and FLOPs.