Alibaba Releases Qwen-UI-Agent: Making Models Truly Use Every Screen

On August 20, Alibaba Qwen released Qwen-UI-Agent, a GUI agent foundation model for real devices covering phones, desktops, web, and deep search. Trained and evaluated on real hardware, it reads screens and mimics clicks, input, and swipes, scoring 82.1% on MobileWorld, 79.5% on OSWorld-Verified, and top in browser WebArena, while stopping to ask for confirmation before sensitive actions like payments.