Master Crawler 2 is a powerful website crawler for Windows.
The tool crawls entire websites, including subdomains,
to a freely adjustable crawl depth, and generates a sitemap.xml.
Simply enter the starting URL of a website and choose the desired crawl depth.
Once the crawl is complete, a full sitemap.xml can be generated with a single click.
Ideal for SEO, website analysis, relaunches, or quickly generating an up-to-date sitemap.
Free to use at your own risk!
Alpha10 on GitHub