Papers/2611.23446
🧪 Test?View on arXiv

Where Global Context and Weight Sharing Work in Compact Vision Backbones

Not provided in the abstract

self-attentionweight sharingcompact models
2611.23446
Builder Relevance
80%
15h ago

Abstract

This paper investigates the effectiveness of global self-attention and weight sharing in enhancing the performance of compact convolutional backbones like EfficientNet.

Reality Card

Core Claim

Inserting lightweight zero-gated residual self-attention adapters into the MBConv trunk improves accuracy to 74.02%, outperforming a plain B0 control by +0.954 percentage points.

Method / Result

Achieved 74.02% accuracy with self-attention adapters, a +10.82 points improvement in a single epoch with weight sharing.

Limitations

The study's reliance on specific configurations and the potential degradation of accuracy with post-hoc kernel averaging may limit reproducibility.

Paper to code

Verified implementation resources so builders can test the paper’s claims instead of stopping at the abstract.

No verified implementation link has been attached yet. AIBuzzHub will keep this panel separate from unverified search results.
← Back to all papers