ReSiReg: Towards Spatially Consistent Semantics in Language-Conditioned Robotic Tasks

Vision-Language Models (VLMs) enable robots to follow open-language instructions. However, dense VLM embeddings have shown to be noisy and lack spatial consistency. This is problematic for robotic applications, which require simultaneous reasoning over semantics and 3D space. We examine spatial stru...