Neil Hughes
Apple's interest in the feature was revealed this week in a new U.S. Patent and Trademark Office filing entitled Augmented Reality Maps. Using an iPhone camera and its wide array of sensors, including GPS, compass and gyroscope, mapping data can be used to visually augment live video.
This process, known as "augmented reality," is already found in many iPhone applications, such as Layar (iTunes link), which can be used for finding local businesses and other locations. Augmented reality presents data to a user in real time by augmenting images of the real world that are displayed via a device's camera.
In Apple's concept, streets, locations and other map data would be overlaid onto the live images being displayed through the iPhone camera. Standing along a street, users could see the street name and individual street addresses displayed in front of them, just by holding up their iPhone and pointing its camera at a location.
Apple's application notes that augmented reality programs are already available, but are typically separate from mapping applications that offer users directions to a location.
"Such systems can fail to orient [users] with a poor sense of direction and force the user to correlate the directions with objects in reality," the filing reads. "Such a transition is not as easy as it might seem.
"For example, an instruction that directs a user to go north on Main St. assumes that the user can discern which direction is north. Further, in some instances, street signs may be missing or indecipherable, making it difficult for the user to find the directed route."
Apple's solution would interpret data describing the surrounding areas, and determine what objects are being viewed by the iPhone at present. This information would be overlaid onto the live video screen, and other features, like searching for locations, would also be accessible from this screen.
"In one form of interaction, a device can receive input from the user requesting directions from a present location to a selected search result," the filing reads. "Directions can be overlaid onto the presently displayed video feed, thus showing a course and upcoming turns."
The system could also give users indications that they are headed in the wrong direction. For example, if they must walk north to find a certain restaurant, and they are headed south, the system could inform them there is "no route" to their selected destination.
The proposed invention made public this week was first filed in February of 2010. It is credited to Jaron Waldman.
Its publication comes just a week after another potential enhancement to the iPhone Maps application was also discovered by AppleInsider. That filing described a system that would exaggerate or even omit some details, like roads or landmarks, to make navigation easier to follow.
Since the release of iOS 3.2 in April 2010, Apple has been relying on its own databases for location-based services. The company has also revealed it is working on a "crowd-sourced traffic" service that will launch in the next few years.
The company also purchased Google Maps competitor Placebase in 2009, and in 2010 it acquired another online mapping company, Poly9. The company's interest in "radically" improving the iPhone Maps application has also been highlighted in job listings advertised by Apple.
Stephen Silver
Christine McKee
Charles Martin
Amber Neely
14 Comments
Augmented reality holds a lot of promise. I've been disappointed with the current implementations. I want artists to do things that will delight the user, like showing giant lizards crawling up and down when you view the Empire State Building, or showing historical views of bygone eras. It would be awesome to click through views starting with rolling hills, progressing through views of log cabins, all the way up to the present built environment.
I hope Apple advances the field.
While it's all well and good Apple is working hard on improving Maps, it really seems like some of these improvements are years away, yet some could be implemented now. I think it would make for a much better transition if they introduced some of these features sooner rather than later (coughturnbyturncough).
This is all very exciting, this implemented by Apple and available to developers through SDK would be awesome. Apple have to break with Google Maps at some point too.
I'm sorry but did they really patent this?
doesn't this exist already?
Maps are just the most obvious of the solution for AR due to it's innate utility. I had this idea years ago (as I'm sure many did) when gimmicky AR apps were starting to appear. We need something well implemented into the core of the OS with APIs that devs can access. It doesn't look like Android will implement it right (they can't even get cut/copy/paste universal) so it's up to Apple to show everyone how its done.
Of course, then we'll hear that Apple didn't invent anything despite everything else following in Apple's footsteps to make their AR look and feel more like Apple's AR APIs.