XML Sitemap Generator

This tool crawls your website starting from the URL you provide, follows all internal links, and generates a standard sitemap.xml file ready to be uploaded to your root directory or submitted to Google Search Console.

It acts like a search engine bot: it respects canonical tags, skips pages marked noindex, and stays entirely within your domain. Because crawling takes time, the scan runs in the background. Once finished, you will get a direct download link for your XML sitemap.

How it works

An XML sitemap is a list of a website's URLs designed for search engines. While search engines can usually discover pages by following links, a sitemap provides a guaranteed list of everything you consider important, which is especially useful for new sites or pages that are hard to reach.

How the crawl works:

The tool starts at the URL you give it (usually the homepage). It downloads the HTML and extracts every <a href="..."> link. Any link pointing to the same domain is added to a queue. It then visits those pages, extracts their links, and repeats the process until it runs out of new pages or hits the limit.

What it ignores:

• External links: It will never follow a link to a different domain.
• noindex pages: If a page has a <meta name="robots" content="noindex"> tag, it is excluded from the final sitemap, since search engines shouldn't index it anyway.
• Canonical tags: If page A says its canonical version is page B, the tool will try to index page B instead.
• Query parameters: Crawlers can get stuck in infinite loops if a site appends tracking IDs or session tokens to URLs. The tool normalizes URLs to avoid duplicating the same page.

The output is a standard http://www.sitemaps.org/schemas/sitemap/0.9 XML file. Once downloaded, you typically place this in your website's public root (as sitemap.xml) and add a Sitemap: https://yourdomain.com/sitemap.xml line to your robots.txt file.

Frequently asked questions