Apple Expands Applebot Crawler With Thousands of New IP Addresses for AI Search
Apple has added more than 4,000 new IP addresses to Applebot, the web crawler that powers search across Siri, Spotlight, Safari, and Apple Intelligence. The change, documented in Apple's official Applebot IP registry with a creation date of July 31, 2026, represents the crawler's first major infrastructure expansion in years.
What changed
Apple's Applebot IP CIDR JSON file now lists 33 network ranges, including 18 new /24 blocks and 3 new /28 blocks totaling approximately 4,656 additional IP addresses. The previous registry had not been updated for several years, according to infrastructure researcher Ryan Siddle, who identified the expansion in a LinkedIn post.
The new ranges are concentrated in the 17.166.x.x and 17.22.x.x blocks, with additional addresses in 17.241.x.x and 17.246.x.x networks. All addresses fall within Apple's allocated IP space.
Details and availability
Apple's documentation states that Applebot crawls data to power search features across Apple's ecosystem, including Spotlight, Siri, and Safari. The company also uses crawled data to train Apple Intelligence and other generative AI features. Web publishers can opt out of AI training by blocking Applebot-Extended in robots.txt, though this does not prevent standard Applebot crawling for search indexing.
The documentation explains that Applebot data may provide "additional context and up-to-date content when AI models are used to generate output for display in Apple products and services," including answers to world knowledge questions in Siri and Search that may link to source websites.
Ryan Siddle noted that OpenAI has previously expanded IP ranges before major model releases, though not at the scale Apple just executed. "For anyone interested in AI Search, make sure Applebot can access your platform," he wrote. "I think something big might be about to happen."
Context
Apple last updated its Applebot documentation in June 2026 to add information about AI, Siri, and Apple Intelligence. The crawler uses reverse DNS verification through the applebot.apple.com domain, and publishers can verify Applebot traffic by matching IP addresses against the published CIDR list.
The expansion comes as Apple continues developing Apple Intelligence features across iOS, iPadOS, and macOS. The company has been integrating generative AI capabilities into Siri and other system services, requiring access to current web content.
What has not been confirmed
Apple has not publicly announced the IP expansion or explained the reason for the timing. The company did not provide information about whether the additional capacity supports a specific new feature, increased crawl rate, or geographic expansion. It is not clear whether this expansion will result in increased crawl traffic for individual websites or changes to how Apple's search features rank or display content.
