COPILOT Vision goes up a gear. Until now limited to the analysis of two windows at a time, Microsoft’s IA tool can now observe everything that is displayed on the screen of your PC. Concretely, it is a sharing mode called “Desktop Share” that the user active manually. By clicking on an icon in the shape of glasses in the Copilot application, it becomes possible to designate a specific screen or window that AI can observe and analyze.
An assistant who sees everything, but at your request
Unlike Recall (called “Find” in French), another very controversial feature of Microsoft capable of automatically taking screenshots at regular intervals, Copilot Vision works only on demand. The activation of sharing is voluntary, and it is enough to click on “stop” or on the cross to end it.
Once activated, the screen sharing function allows Copilot to analyze the content displayed and answer questions or provide suggestions in context. AI can thus ” Help improve a creative project, correct a CV or guide the user in a new video game “, According to Microsoft. The system behaves a bit like an enriched vocal assistant, capable of seeing what you see and commenting out loud what is happening on the screen.
Copilot can also answer practical questions like ” What does this error message mean? »Or« How to create a table in Excel? ». Better yet: the update now allows you to trigger this visual assistance directly from a voice conversation with Copilot. The user can, during an oral exchange with AI, click on the glasses icon to share their screen and give more context to the discussion.
This feature is part of a series of developments intended to make the AI more useful and proactive in Windows 11. It completes in particular the “highlights” system, which automatically offers useful content according to the applications and sites consulted.
The update is currently being deployed via the Microsoft Store for users of the Windows Insider program, in the regions where Copilot Vision is activated. This is version 1.25071,125 (or later). Not all testers will receive the tool at the same time, but Microsoft promises to expand availability over the weeks.
🟣 To not miss any news on the Geek newspaper, subscribe to Google News and on our WhatsApp. And if you love us, .
