Enter a bare domain (example.com), a path, or a full URL depending on match type below.
Pulled live from our global web index. "All time" scans every snapshot in the index one by one — thorough, but slower, and capped by Max results.
"Domain" returns every page on the site and its subdomains. "Domain only" returns every page on that exact host, excluding subdomains like blog.example.com. "Prefix" matches everything under a given path. "Exact" matches one URL only.
Large sites can return millions of rows — cap this while testing.
Pause between each request so the index server doesn't rate-limit you. Raise this (e.g. 800–1500) if you're seeing "connection failed" errors on large or "All time" scans.
On a failed or rate-limited request, waits longer each time (1s, 2s, 4s…) and retries. After retries run out, that page is skipped and the scan keeps going — nothing already found is lost.