Apple details new 'AppleBot' web crawler used by Siri and SpotlightApple has confirmed the existence of a long-rumored web crawling service — first noticed last November — and provided some details of its operations in a recently-updated support document.
According to Apple, AppleBot is a crawler that primarily serves Siri and Spotlight. Both services offer web search capabilities, though until now it was thought that Apple routed queries through an existing search engine such as Google or Bing.
AppleBot operates similarly to Google's Googlebot, and Apple advises developers that it will follow Googlebot instructions if no AppleBot-specific instructions are found. Website operators are urged to contact Apple's network operations center if they have questions or concerns about the crawler.
It's not clear how long AppleBot has been operational in production. The support document first appeared in February, but was only populated with content last month.
One web developer spotted Apple's crawler last November, after seeing numerous hits from a crawler in the 184.108.40.206/8 block. That block is assigned to Apple, one of just a handful of companies that control an entire A block.
On Topic: General
- Apple looks to debut Siri SDK at WWDC, developing Amazon Echo competitor
- Apple brings back crypto whiz Jon Callas as encryption battles heat up
- Pebble unveils Pebble 2 and Time 2 smartwatches, 3G-enabled Core running accessory
- Local sourcing rules may still block Apple Stores from expanding into India
- Will.i.am debuts i.am+ EPs earphones as Apple Store exclusive