Screening Is Effective for Visual Recognition

Vision Transformer (ViT) has been widely used as a powerful framework for modeling global dependencies among image patches.

Vision Transformer (ViT) has been widely used as a powerful framework for modeling global dependencies among image patches. However, its core component, self-attention assigns softmax-normalized relative weights to all patches, making it difficult to evaluate the relevance…