Google updates Circle to Search to identify multiple objects in one image

When Google first introduced Circle to Search in early 2024, the idea seemed deceptively simple: circle anything on your smartphone screen and instantly get search results. Two years later, the company continues to develop this concept, and a fresh update makes the feature significantly smarter — it can now analyze multiple objects in a single image, freeing users from having to circle each item individually.

To understand the significance of this step, it's worth recalling how visual search worked before. The classical model involved sequential interaction: spot something interesting — circle it — get the result. If a photo from Instagram caught your eye with a model's jacket, her sneakers, and a bag in the background, you had to repeat the process three times. This created noticeable friction, especially in scenarios where a user is browsing inspiring content and wants to quickly identify everything that caught their attention. The updated Circle to Search solves this problem fundamentally: the system now recognizes all significant objects in the frame itself and offers information about each one.

Technically, this stems from the evolution of Google's multimodal models. The company doesn't disclose architectural details, but the logic is clear: instead of processing a single highlighted image fragment, the system now performs full scene segmentation, identifies individual objects, classifies them, and launches a search query for each. This requires significantly greater computational resources, but Google has apparently optimized the process enough to keep it fast on user devices. Likely, part of the processing happens on the server side, and part locally, using neural processors in modern chips.

The most obvious use case is shopping. Google is essentially turning any photo into a storefront. See a stylishly furnished room on Pinterest — Circle to Search will show you where to buy each piece of furniture. Stumble upon a street style photo — you'll get links to similar clothing, shoes, and accessories. It's not just convenience; it's direct monetization of visual content through Google's advertising ecosystem. The company is creating the shortest path from inspiration to purchase, and each such transition potentially generates advertising revenue.

For the e-commerce industry, the consequences are serious. Platforms like Pinterest and Instagram have spent years building their own visual shopping tools, integrating product tags and affiliate links. Google, meanwhile, offers a universal solution that works on top of any app at the operating system level. This undermines social platforms' monopoly on visual commerce and redirects the flow of shopping attention back to Google's search ecosystem. For brands, this means high-quality visual content becomes even more important — if your product looks good in photos, Google will find it itself and offer it to customers.

There's also broader context. Circle to Search is part of Google's strategy to reimagine search in the era of generative AI. The company understands that the text search bar is no longer the sole interface. People increasingly want to interact with information naturally — by pointing at objects, asking questions by voice, combining modalities. Each Circle to Search update brings us closer to a world where search becomes invisible, embedded in the very act of interacting with the screen.

However, privacy remains a question. When the system analyzes all screen content and sends data to servers for processing, the volume of information collected about user preferences grows exponentially. Google knows not just what you searched for, but what caught your attention in every image you view. This is a goldmine for targeted advertising and simultaneously a cause for concern among regulators.

The Circle to Search update looks like a small incremental step, but it actually reflects a fundamental shift in how we interact with visual information. Google is methodically building a bridge between sight and action, between what we see and what we can do with it. And with each such update, that bridge becomes shorter.