Tools HQ / GONE
GONE
You decided what should happen to each URL: 410 or 404, a 301 or 308 to a target, noindex, unavailable_after, or stay live. GONE checks what the server actually does against each URL's own intent, follows the redirect chain, reads meta robots and X-Robots-Tag, flags anything still listed in a sitemap and gives every problem a severity. Then it puts a value on fixing the mismatches.
1. URLs and intent
Each URL is judged against its own intent.
One per line: url,intent,target. Intent is 410, 404, 301 or 308 (with target), noindex, unavailable_after (date/time in target) or 200.
2. Sitemap (optional)
3. Run
Browsers can't see redirect hops or most headers on other sites, so the full check runs in a small Python script on your machine (gone.py v0.2). Download the CSV above, run this, then import the result here.
Download gone.py v0.2Needs Python 3.8 or newer and the requests library. pip install requests python3 gone.py urls.csv --out gone-report
- --sitemap repeatable; a URL or a local file; follows sitemap indexes and .gz
- --mode standard | facet | post-event (default standard)
- --default-intent intent for rows without one (410; facet 404; post-event unavailable_after)
- --migration-sitemap sitemap is an old-URL sitemap kept during a move: listed URLs are Low
- --no-robots skip the robots.txt check
- --workers parallel requests (default 4)
- --delay pause per worker between requests (default 0.2s)
- --max URL cap (default 2000)
It writes gone-report.csv and gone-report.html, with severity, mode and robots_txt columns. Then import gone-report.csv here. Reports from v0.1 still import.
Match
0
Warn
0
Mismatch
0
Blocked
0
4. Results
| Verdict | Severity | URL | Intent | Chain | Robots | Sitemap | Why | Value |
|---|---|---|---|---|---|---|---|---|
| No results yet. | ||||||||
What Google says
- HTTP status codes and network errors - how Google handles 4xx and redirects
- Managing crawl budget - 404/410 for removed pages; noindex does not save crawl
- Managing faceted navigation - empty filter pages should return 404
- Robots meta tag - unavailable_after
- Site moves with URL changes - irrelevant redirects, hops, migration sitemaps
- Build and submit a sitemap
Google gives no fixed time for a removed URL to drop out of its index. It depends on when the URL is next crawled.
Nothing you paste leaves this page except the URL checks you run.