Microsoft (MSFT.O) has introduced a suite of artificial intelligence upgrades for Windows 11, designed to increase the utility of its Copilot AI assistant by improving task automation and its integration with services across various devices.
The company announced a new opt-in feature that enables users on any Windows 11 PC to activate the assistant with the voice command “Hey Copilot” to execute tasks hands-free.
Furthermore, Microsoft is expanding the availability of Copilot Vision—a feature that can interpret content displayed on a user’s screen and provide relevant answers—to all markets where Copilot is available.
An upcoming feature for participants in the Windows Insiders program will also allow interaction with this vision capability via text, in addition to voice commands.
The enhancements are part of Microsoft’s broader effort to accelerate the adoption and use of Copilot, positioning it to compete more effectively with AI assistants from rivals like Google and Meta, which are integrated into their own devices, apps, and browsers.
The update also introduces an experimental ‘Copilot Actions’ mode, empowering the AI to execute real-world tasks directly from the desktop, such as making restaurant reservations or ordering groceries.
This tool builds upon a similar functionality that was initially previewed for the web browser in May.
Microsoft emphasized that these AI agents will initially operate with restricted permissions, gaining access only to user resources that are explicitly granted.
Separately, the company launched its ‘Gaming Copilot’ for embedded Xbox Ally consoles on Thursday. This feature provides players with real-time gameplay tips, recommendations, and support through the AI assistant.
“We believe we are at the dawn of the next evolution, where AI is not confined to a chatbot but is seamlessly integrated into the hundreds of millions of experiences people use daily,” stated Yusuf Mehdi, Microsoft’s Consumer Chief Marketing Officer.
