Learning Robust Dexterous In-Hand Manipulation from Joint Sensors with Proprioceptive Transformer

In-hand object manipulation is a fundamental yet challenging capability for dexterous robots. Despite significant progress in dexterous manipulation, existing approaches rely heavily on vision or tactile sensing to track object states, while joint sensing -- the most readily available modality on an...