Tuesday, December 10, 2013, 09:19 am PT (12:19 pm ET)
Tests find iOS 7 update improves Apple's Siri, but Google Now for Android closes the gapApple has improved its voice-driven personal assistant, Siri, with the iOS 7 update for iPhone and iPad, though Siri's chief competition, Google Now, has improved enough to be on par, new tests have concluded.
Analyst Gene Munster and his team at Piper Jaffray pitted Siri on iOS 7 against Android's Google Now in a barrage of new tests, and found that the two competing personal assistants are about even in terms of performance. Both were given a grade of "C+."
That was a marginal improvement for Siri, which earned a grade of "C" last year in iOS 6. With a check of 800 queries, Munster found that iOS 7 has improved Siri's ability to translate speech better in a noisy environment, with accuracy increasing from 83 percent to 94 percent.
The tests also found that Siri in iOS 7 has an improved ability to answer questions, with accuracy improving slightly from 77 percent to 79 percent.
iOS 7 has also further reduced Siri's reliance on Google for delivering data to users. While last December, Siri relied on Google for 27 percent of its data, according to tests by Piper Jaffray, Google now provides just 4 percent of Siri data, having been replaced largely by Microsoft Bing, Wolfram Alpha, and Wikipedia.
As for Google Now, its grade improved more significantly, from "D-" to "C+," with major improvements in comprehension and accuracy. In particular, Google Now's ability to understand users in a noisy environment grew from 78 percent accuracy in December 2012 to 92 percent in December 2013.
The tests show that Siri is still slightly more accurate than Google Now when both services correctly understand the user's query. While Siri has an 83 percent accuracy rate, according to Piper Jaffray, Google Now provided the correct answer 81 percent of the time.
Still, Google Now's ability to correctly answer a question saw significant gains in the last year, growing from 72 percent accuracy to 81 percent. In the same period, Apple's Siri went from 81 percent accuracy to 83 percent.
In terms of total effectiveness, both Google Now and Siri are in a dead heat, with 79 percent accuracy rate in understanding queries presented by Piper Jaffray tests. As a result, both platforms were graded as a "C+" as of December 2013.
On Topic: Google
- New Android 'Fake ID' flaw empowers stealthy new class of super-malware
- Tests find Apple's Siri improving, but Google Now voice search slightly better
- Editorial: Google, Microsoft claiming Apple's crown, albeit from 1994
- Google and Samsung escalate hostilities over watches, Tizen and Android's openness
- Google Analytics gets dedicated iOS app, Facebook adds celebrity-focused Mentions app