CHASM: Cross-frequency Harmonized Axis-Separable Mixing for Spectral Token Operators

Spectral token mixers based on Fourier transforms provide an efficient way to model global interactions in visual feature maps. Existing designs often either apply filter-wise spectral responses along fixed channel axes, or learn adaptive frequency-indexed channel mixing without explicitly aligning ...