We are currently experiencing server issues, please excuse any mess. More details are availble here.
Evidence shows Apple operating a mysterious Web crawling botA developer has discovered that Apple appears to be crawling HTML websites with its own automated bot, but the exact purpose of the mysterious homegrown software remains unknown.
Evidence of Apple's Web crawler, written in the Go programming language, was first discovered by developer Jan Moesen, who has found hits from the software dating back to Oct. 15. Others have discovered significant traffic to their websites from Apple's mysterious crawler, which appears to be shut off from time to time.
The crawler was found originating from an IP address starting with "17.", which would indicate that the bot is emanating from Apple's servers.
It's unknown whether the Apple bot is an official project for the company, or if an employee built and ran the system in an unofficial capacity from a company machine.
It's possible that Apple's efforts could be related to Spotlight enhancements in both OS X Yosemite and iOS 8. Both were updated this fall with improvements that allow users to access Web search content directly, without the need to access a third-party search tool such as Google or Bing.
Though Apple doesn't compete directly with the likes of Google or Microsoft Bing, the company has been working to provide specific information directly within Siri search results. Doing so makes it unnecessary to provide potential links through the official Siri Web search partner, Bing.
On Topic: General
- First look: DJI touts Mavic Pro drone's compact design, spotlights continued partnership with Apple
- DJI launches ultraportable iOS-connected Mavic Pro camera drone for $999
- Apple patents laser mapping system, hybrid mechanical-capacitive keyboard, invisible I/O connectors
- Apple, Silicon Valley raised millions to fund Hillary Clinton platform backing tech's positions on encryption, privacy, innovation, patents, education
- Disney said to be weighing Twitter purchase to bolster online video efforts