While most of the focus on Apple's purchase of Shazam notes the music and audio recognition engine, the company also has a machine learning vision system and an augmented reality product currently in use in the advertising industry to deliver product visualizations, and 360-degree videos.
New Apple acquisition Shazam launched its visual recognition engine in 2015. As a follow-on to that Shazam announced a "massively scaled augmented reality platform" in March 2017. At launch, the platform allowed users to scan "Shazam Codes" with the content from partners displayed on a smartphone after the scan.
At launch, the functionality existed within the Shazam app. The primary partner at launch was liquor company Beam Suntory. The effort was praised because of market penetration that the company had with its Shazam app — now eclipsed many times over by Apple's rollout of ARKit in iOS 11.
The predecessor to the Shazam augmented reality technology, Visual Shazam, used a QR code, a product scan, or a print advertisement scan to deliver content related to the ad. Disney's "Tomorrowland" movie was one of the first efforts using the nascent technology. At that time, besides Disney, launch partners included Levis, Hearst, Conde Nast, Time, and Harper Collins.
Apple CEO Tim Cook frequently espouses the virtues of augmented reality in interviews. He has called it superior to virtual reality, as it is more social and less isolating for users.
"Think back to 2008, when the App Store went live. There was the initial round of apps and people looked at them and said, 'this is not anything, mobile apps are not going to take off,'" Cook said in an interview in October. "And then step by step things start to move. And it is sort of a curve, it was just exponential — and now you couldn't imagine your life without apps. Your health is on one app, your financials, your shopping, your news, your entertainment — it's everything. AR is like that. It will be that dramatic."
Apple's ARKit was demonstrated at the 2017 WWDC. Since launch, not only has Ikea launched its ARKit app to virtually drop furniture in a home, but Amazon has added the ability in its iOS app to display some of its products in the user's environment.
6 Comments
Yeah, like you I figured from the get-go that this was about augmented reality functions and IP. Doesn't mean it is, but seems likely.
AR glasses, here we come!!!
I have a feeling 3 years from now it will even look like more of a bargain than it is today
Now if they would only buy Live Nation and really jumpstart their Augmented Reality Entertainment before Amazon scoopes them up
https://www.wired.com/brandlab/2017/07/live-concerts-take-virtual-virtual-reality/
"For much of a VR concert, the participant is looking from stage into the crowd, offering an approximation of what it feels like to be the singer or guitarist during a show. It’s better than the best seat in the house, in other words."
"Live Nation for one is not new to streaming; the company streamed more than 600 concerts online. But while traditional Internet-based streaming is much like TV, VR is more like actually attending the concert – or even better in some ways since the view is likely to be an improvement unless you happen to be right up against the stage. Plus, you don’t have to drive home when it’s over.
One area for improvement is to be able to buy the shows on a pay-per-view basis, after the fact. Right now, because of copyright concerns, fans can only watch the shows in real time. “If I couldn’t make it to the show then I could watch it on VOD,” said LaMeyer, who added that she’d also like to re-watch shows that she attended."
I'm probably wrong but, if the embedded video shows the extent of what the Shazam AR engine can do, Apple did not buy Shazam for its AR capabilities. But, of course, I also can't figure out what Shazam's value is for Apple (perhaps it is like Amazon owning IMDB or Sony previously owning Gracenote?). My best guess is that there is some need for an "always-listening" song identification feature and paying Shazam on a per-use basis was not economic. But this seems inconsistent with Apple's privacy-first approach. Maybe some local version or robust anonymization/activity deletion?