(Translated by https://www.hiragana.jp/)
Circle to Search for Windows: 4 AI-powered visual search tricks โ€“ Computerworld

Circle to Search for Windows: 4 AI-powered visual search tricks

tip
Jul 16, 20258 mins
Google SearchWeb SearchWindows 10

We've come a long way from traditional search โ€” and Windows is no exception.

Windows Circle to Search: AI visual search
Credit: Microsoft/JR Raphael

Sometimes, the best way to look something up is to provide an image of what youโ€™re thinking about rather than trying to describe it.

Android phones offer a convenient โ€œCircle to Searchโ€ feature, which is now integrated with Googleโ€™s Gemini AI assistant. You can get convenient insights about anything you see on your screen just by highlighting it. Windows PCs have similar features, too, and theyโ€™re surprisingly easy to find โ€” once you know where to look.

While Microsoft is showing off fancy AI-powered features like โ€œClick To Doโ€ that require a Copilot+ PC, you donโ€™t need any special hardware for this handy trick. These visual search features will work on any Windows 11 PC โ€” and most of them will work just as well on Windows 10, too.

Want more Windows tips? Sign up for my free Windows Intelligence newsletter. Iโ€™ll send you free Windows Field Guides as a special welcome bonus!

Option #1: Search with Google Lens in Chrome

If you use Chrome, you can quickly access an Android-style visual search feature from right within your Windows browser. Just right-click a web page and select โ€œSearch with Google Lensโ€ โ€” or click Chromeโ€™s menu button and select โ€œSearch with Google Lens.โ€

Then, select anything you want on the current web page. You can click an image, select text, or just draw a box around the area of the page you care about. (A box may not technically be a circle, but itโ€™s what Google offers in this environment.)

Youโ€™ll see search results show up in a sidebar โ€” not just related search results, but an AI overview from Googleโ€™s Gemini, too. This could help you identify what an image is, as well as find more information about the subject, provided that the AI-generated info is actually accurate.

Google Lens in Chrome
Chrome lets you search Google for an image just as easily as you could search for text โ€” with a quick AI overview, too.

Chris Hoffman, Foundry

Option #2: Send screenshots to an AI or image search tool

Rather than relying entirely on your browser, hereโ€™s what I recommend: Take your own screenshot first. Then you can provide the screenshot to whatever tool you want. Itโ€™s the most flexible solution.

On both Windows 11 and Windows 10, this is easy with the built-in screenshot tool. You can press the Print Screen key or the Windows+Shift+S shortcut to start capturing a screenshot.

Use the buttons at the top of the screen to select what type of screenshot you want to take. A quick Rectangle screenshot works well, but you can use a freeform โ€œcircleโ€ if you like.

Snipping Tool sidebar
I prefer capturing a rectangle of exactly what I want to share, but the Snipping Tool includes lots of options.

Chris Hoffman, Foundry

Once you take the screenshot, Windows will save it to your clipboard. You can then insert it into any app or web page where you can paste something. Just press Ctrl+V.

For example, you could pass the image to an AI assistant โ€” ChatGPT, Copilot, Perplexity, Gemini, or any other AI app or web-based AI tool you prefer. Most tools support pasting images, so you can press Ctrl+V to paste your image and then ask whatever you want about it. You could just send the image alone and likely get a description of it โ€” but generative AI tools will give you a better result if you explain what youโ€™d like to know about the image.

You could also use the Snipping Tool for plain-old image searches. For example, you can head to Google Images, click the little โ€œSearch by imageโ€ button in the search bar, and press Ctrl+V to paste your screenshot right into the web page.

The Snipping Tool has some additional options to streamline things on Windows 11. You can click the menu button and select โ€œVisual Search with Bingโ€ to perform a Bing image search or select โ€œShareโ€ and then send the screenshot directly to the Copilot app, for example. But a simple copy-paste will be flexible and work with more tools.

Snipping Tool menu options
The Snipping Tool can start a Bing visual search or share an image with other apps, but I recommend copy-and-paste.

Chris Hoffman, Foundry

Option #3: Share apps with an AI in real time

On Android phones, Google offers Gemini Live so you can chat about anything you see. On a Windows PC, you have some solid options if youโ€™re looking for real-time voice chat with an AI assistant while it sees your screen.

  • Share any desktop application with Copilot: With Copilot Vision, you can launch Copilot and use Copilot Vision to share a real-time video of an application on your desktop with Copilot and discuss it in your voice. This is an impressive feature that ChatGPT โ€” the most popular voice assistant app โ€” hasnโ€™t delivered on Windows PCs yet.
  • Share your Chrome browser with Gemini: If you have access to Gemini in Chrome, you can click the Gemini icon on Chromeโ€™s title bar and click the โ€œGo Liveโ€ button at the bottom-right corner of the popup window. Gemini will only be able to see whatโ€™s in your Chrome web browser, though โ€” not anything else on your desktop.
  • Share your Edge browser with Copilot: If you use Edge, you also have access to Copilot Vision right in your browser. Just open the Copilot sidebar and click the microphone-shaped โ€œTalk to Copilotโ€ icon. Edge will share your browser with the AI in real time while you chat.

Notably, these arenโ€™t agentic features. In other words, the AI canโ€™t browse for you or use your applications on your PC for you โ€” not yet, anyway. However, it can describe what you see on your screen, and it might have other useful features. For example, with Copilot Vision, Copilot can highlight areas of the screen itโ€™s describing.

If youโ€™re using a genAI tool that doesnโ€™t support real-time videos โ€” such as ChatGPT โ€” youโ€™ll have to paste screenshots into it. But I find this works best much of the time, anyway. I personally think text responses are richer and more useful than voice conversations, though your mileage may vary.

Itโ€™s also worth noting that the specific AI features you have available on your PC will depend on what country youโ€™re in, what subscriptions youโ€™re paying for (Google AI Pro subscribers will have more Gemini features earlier, for example), and other factors. Itโ€™s tough to say what you might see on your PC. For example, if you have a Windows PC or Google Chrome install managed by an IT department, you might not have access to these tools.

Gemini Live
Googleโ€™s Gemini Chrome integration offers an easy way to โ€œGo Liveโ€ and share whatโ€™s in your browser with the AI system.

Chris Hoffman, Foundry

Option 4: Highlight and copy any text on your screen

Android makes it easy to capture text on your screen so you can copy it to your clipboard or perform a web search. This is possible on Windows, too โ€” if youโ€™re using Windows 11, where the Snipping Tool has built-in optical character recognition support.

To do this, just take a screenshot (with Print Screen or Windows+Shift+S), click the thumbnail image notification that pops up, and then use the โ€œText actionsโ€ button in the Snipping Tool window to select text.

Microsoft is working to streamline this in a future update to the Snipping Tool. Soon, youโ€™ll be able to select the Text actions tool right from the screenshot bar that appears when you press Print Screen or Windows+Shift+S. You wonโ€™t need as many clicks.

Text actions in Snipping Tools
The Snipping Toolโ€™s built-in OCR tool is extremely convenient.

Chris Hoffman, Foundry

Using Windows 10? You can still do this by installing Microsoft PowerToys and using the PowerToys Text Extractor utility. But on Windows 11, itโ€™s built in. (The built-in screenshot tool is one particular app that got a significant upgrade with Windows 11.)

Looking for more? Sign up for my free Windows Intelligence newsletter. Youโ€™ll get free copies of Paul Thurrottโ€™s Windows Field Guides as a bonus when you sign up!

Chris Hoffman

Chris Hoffman is a tech journalist and columnist who's been writing about Windows for over a decade. His Windows Intelligence column helps you make the most of your Windows PC โ€” and understand what Microsoft is up to.

Chris was formerly the Editor-in-Chief of How-To Geek, where he racked up over a billion page views to helpful tips, useful troubleshooting guides, and informative editorials โ€” with Windows always as his main focus. Beyond that, he's also written for The New York Times, PCWorld, Reader's Digest, and more.

His free Windows Intelligence newsletter brings you even more Windows goodness, delivering you three things to know and three things to try on your Windows PC every Friday. Sign up today!

More from this author