Aggregating Nested Transformers

The idea of nesting basic local transformers on non-overlapping image blocks and aggregating them in a hierarchical manner is explored and extended to image generation and it is shown NesT leads to a strong decoder that is 8 × faster than previous transformer based generators.