SS

The implementation of SS ViT: Observing Pathologies of MLP Weights and Re-setting Vision Transformer

Environment

• python 3.8
• pytorch 1.7.1 (>=1.2.0)

Models

DeiT-D ss-DeiT ss-Swin ss-XCiT ss-PVTv2

Checkpoint

BaiduDisk

Acknowledgement

This repo benefits from awesome works of Timm.