Microsoft’s Copilot Vision now sees your entire screen to guide you through apps

Currently limited to US Insiders, Copilot Vision will soon highlight interface elements during app guidance. Unlike Recall’s snapshots, it functions like a Teams screen-share with AI commentary.
Microsoft's new Copilot Vision can now view any app on your Windows PC, offering real-time guidance like Photoshop tutorials by highlighting on-screen features, expanding beyond its original Edge browser limits.

Microsoft is testing a major upgrade to its Copilot AI that can view your entire screen instead of just working within the Edge browser.

The new Copilot Vision feature helps users navigate apps like Photoshop and Minecraft by analysing what’s on display and offering step-by-step guidance, even highlighting specific tools instead of just giving verbal instructions.

The feature operates more like a shared Teams screen instead of Microsoft’s controversial Recall snapshot system.

Currently limited to US beta testers, Copilot Vision will eventually highlight interface elements directly on users’ screens. It works on standard Windows PCs instead of requiring specialised Copilot+ hardware, with mobile versions coming to iOS and Android.

Alongside visual assistance, Microsoft is adding document search capabilities. Copilot can now find information within files like Word documents and PDFs instead of just searching by filename.

Both updates will roll out fully in the coming weeks, potentially transforming how users interact with both apps and documents on their Windows devices.

For more information on these topics, visit diplomacy.edu.