Tools HQ / BOTCHECK
BOTCHECK
Paste access log lines. BOTCHECK finds every request that claims to be a Google crawler, checks the IP against Google's published crawler lists, and flags fake Googlebots plus real ones that your server or CDN answered with 403, 429, 5xx or a challenge.
Log lines
Apache / Nginx combined format, or one JSON object per line (CDN log fields like ClientIP, EdgeResponseStatus, ClientRequestUserAgent, SecurityAction work).
Lines matching this pattern count as challenged. A plain log can't always tell a challenge from a 403.
Google IP lists
- Common crawlers (Googlebot etc.)bundled snapshot
317 prefixes . Google list dated 2026-10-21 . fetched 21 Oct 2026, 22:32 BST
- Special-case crawlers (AdsBot etc.)bundled snapshot
272 prefixes . Google list dated 2026-10-21 . fetched 21 Oct 2026, 22:32 BST
- User-triggered fetchersbundled snapshot
1068 prefixes . Google list dated 2026-10-21 . fetched 21 Oct 2026, 22:32 BST
- User-triggered fetchers (Google)bundled snapshot
504 prefixes . Google list dated 2026-10-21 . fetched 21 Oct 2026, 22:32 BST
- User-triggered agentsbundled snapshot
20 prefixes . Google list dated 2026-10-21 . fetched 21 Oct 2026, 22:32 BST
The old googlebot.json path now redirects to common-crawlers.json. Google regenerates these files often, so counts change. A browser can't do reverse DNS, so use the copied commands below for anything you want to double-check.
Everything runs in this page. Log lines are not uploaded.
Page weight limit used: 2000000 bytes.