Pasted URL lists are processed locally. Crawling contacts the URLs you choose and any proxy you provide.

XML Sitemap Generator

Build a sitemap from an exported URL list, or try a browser crawl when the site allows it.

All tools
Browser crawling is limited by CORS. URL-list mode is mainly for links exported from another crawler or browser extension; live crawls work only for sites that allow cross-origin fetches or through a compatible proxy.
0 URLsVisited 0Queued 0
Ready