Turning surroundings into a 'virtual screen' could help machines see better in 3D

Imagine navigating a city street during rush hour—cars and bikes zipping by, pedestrians hustling down a crowded sidewalk, your eyes adjusting to the shop windows' glare in one moment and a dark underpass the next. Our brain, of course, does all this without us being aware of the complex processes going on in that moment. In real time, our eyes and brain create a three-dimensional, accurate representation of a dynamic scene, constantly calculating distances between objects with myriad shapes, sizes, and surfaces.