Apple's heretofore puzzling buyout of Israeli sensor firm PrimeSense — which created hardware designed to "see" in three dimensions — now makes more sense in light of last week's acquisition of Metaio, a German software company specializing in augmented reality technology.
Apple snagged PrimeSense in late 2013 for $345 million, making it one of the largest deals in Apple's history. Until then, PrimeSense was known mostly for designing the first-generation Kinect for Microsoft.
Those trying to figure out what Apple might do with PrimeSense initially focused on Kinect-like applications. The consensus was that PrimeSense's technology would eventually make its way into the Apple TV, either to enable a new gaming use case or to replace the traditional remote control.
That could still be the case, but it seems that something more was brewing in Cupertino.
Picking up both PrimeSense and Metaio indicates big augmented reality ambitions at Apple.
Last week, Apple acquired Metaio, a well-known name in the augmented reality space. Metaio's technology powers most of the popular AR applications in the market today — Â Ikea's well-received virtual catalog, for instance, along with Audi's digital owner's manual and Ferrari's AR showroom app.
All of these applications work quite well in their current incarnations, but there are limitations to what AR can achieve when it's working with a flat plane. Depth can be inferred from images, of course, but more accurate three-dimensional mapping means more immersive AR.
As it happens, three-dimensional mapping was PrimeSense's reason for being.
Among other applications, PrimeSense technology was used by Qualcomm for early versions of its Vuforia AR platform and by iRobot for its Ava autonomous robot platform, which can navigate around new spaces independently.
One can fathom numerous uses for augmented reality at Apple — Â AR maps and games immediately spring to mind, as do more esoteric uses, like a new method of filmmaking. Imagine doing away with chromakeying — Â known colloquially as green screening — Â in favor of a system that can intelligently differentiate between actors and background objects, and is only available for use with Final Cut.
"Instagram applies filters to the whole scene, but this allows you to apply filters to different layers of the scene," Venkataraman said. "That gives the potential for creating much more interesting filters."
No matter what product eventually materializes, it seems a safe bet that Apple hasn't spent hundreds of millions of dollars just to let us navigate Netflix by waving our hand in the air.