Octopus: History-Free Gradient Orthogonalization for Continual Learning in Multimodal Large Language Models

Continual learning in multimodal large language models (MLLMs) aims to sequentially acquire knowledge while mitigating catastrophic forgetting, yet existing methods face inherent limitations: architecture-based approaches incur additional computational overhead and often generalize poorly to new tas...