Affiliate Disclosure
If you buy through our links, we may get a commission. Read our ethics policy.

Google Maps for iOS uses Gemini to pull places from screenshots

Location info can be pulled from screenshots by Google Maps on iOS - Image Credit: Google

Google Maps is making more use of Gemini, with the AI service now identifying locations in iPhone screenshots.

Like other navigation tools, Google Maps lets users create lists of locations, making it helpful for long trips and vacations. However, with a new update, the app will make it easier to add locations automatically, rather than doing so manually.

Initially announced in March, Google Maps for iOS will now include a new "Screenshots" list under the "You" tab. That list will be an automatically-populated collection of locations, sourced from screenshots.

The idea is based on the principle that people often take screenshots of webpages for later reference, rather than manually making notes.

As Google's blog explains, Google Maps will use Google Gemini's AI to scan screenshots taken on the iPhone for location information. If a place is recognized, typically by including some searchable text that reveals a location, it will be added to the Screenshots list.

The functionality won't be immediately available to users, as they first have to select to try the function out. They are also asked to agree to a system request to allow Google Maps access to photos.

If Maps recognizes a place, it will pop up a message saying there's places ready for review on the list. Users can then select which images and locations to be added to the list, and become viewable on the main map view.

If users don't agree to provide access via the system request, they can also upload screenshots to the list manually.

The update is slowly rolling out to users from Thursday, starting with those using iPhones in US English.

2 Comments

rotateleftbyte 13 Years · 1639 comments

Is there no limit to how low Google will stoop? Don't answer that. They know no limits in their quest to know more about you than you do.

If you use Google for anything, now is the time to stop and ask if you should continue to let them have free access to your phone which for many people IS THEIR LIFE.

NO, NO and thrice no.

4 Likes · 1 Dislike
danox 12 Years · 3744 comments

No thanks insidious… But for those that do use it I’m sure Apple is getting paid for infrastructure access.

0 Likes · 2 Dislikes