Web Crawl

Crawl a domain or sitemap, track discovered URLs, and inspect statuses, redirects, and canonicals.