Drift Happens: An Empirical Study of Neural Architecture Robustness to Temporal Distribution Shift

Real-world data distributions evolve over time, inducing temporal distribution shift that can substantially degrade the reliability of deployed machine learning systems. However, the extent to which architectural choices and their associated inductive biases affect temporal robustness remains insuff...