Home About Services Tools Blog Get Started
8-PHASE BFS PIPELINE

Free Sitemap Generator

Make a simple list of your website's pages that search engines can read. Enter your URLs, click generate, and download your sitemap file. No coding needed.

Sitemaps.org 0.9 Standard UTF-8 Encoded No Sign-Up Needed Google Search Console Ready

Build Your Sitemap

Enter your website pages below. We will create a correct XML sitemap file for you.

Enter your website URL. In Auto-Crawl mode, the 8-phase engine will scan it automatically.
Phase 1: Initializing... Running
Ready to crawl website. Click "Generate Sitemap" below.
Phase 6 Metadata & Defaults
Sitemap XML Preview UTF-8 · Single
5
Discovered URLs
1.1 KB
Uncompressed Size
Valid 0.9
Phase 8 Audit
✓ Sitemap XML copied to your clipboard!
FULL PIPELINE OVERVIEW

Engineered for Deep, Accurate Crawling

How our 8-phase crawler discovers, verifies, normalizes, and packages every valid page on your domain.

PHASE 1

Setup & robots.txt

Fetches and parses robots.txt. Extracts Disallow, Allow, and Sitemap: lines so search engine rules are strictly honoured.

PHASE 2

Seed Collection

Gathers initial seeds from robots.txt, existing CMS sitemaps (/sitemap.xml, /wp-sitemap.xml), and manual inputs to catch orphan pages with zero inbound links.

PHASE 3

Crawl (BFS Loop)

Runs a concurrent breadth-first search (BFS) queue. Crawls broad pages before going deep, preventing infinite loops down dynamic query trees.

PHASE 4

Fetch & Canonical

Validates HTTP 200 responses, follows redirects safely, eliminates noindex tags, and resolves canonical URLs to prevent duplicate indexing.

PHASE 5

Link Extraction

Comprehensive extraction from <a href>, <link rel="next/prev">, and image maps while filtering out media files, mailto, and external domains.

PHASE 6

URL Normalization

Lowercases scheme and host, normalizes slashes, strips tracking parameters (utm_*, gclid, fbclid), and cleans fragments (#section).

PHASE 7

Build Sitemap(s)

Compiles compliant XML with UTF-8 encoding. Automatically splits at Google's 50,000 URLs / 50MB limit and generates a sitemap-index.xml.

PHASE 8

Validate Output

Pre-flight verification audit: checks file byte sizes, syntax structure, entity escaping (&amp;), and ensures zero off-domain inclusions.

Key Robustness Decision Why It Matters for Your SEO
BFS (Breadth-First) not DFS Ensures broad coverage across core category and navigation pages first, preventing the crawler from getting stuck down deep single branches.
Concurrency + Polite Delay Fast crawl execution on large sites while respecting target web server resources without triggering rate limits or bans.
Seed from Existing Sitemaps / robots.txt Catches critical orphan pages and unlinked landing pages that pure link-following web crawlers would miss.
Follows Redirects Instead of Dropping Redirected URLs still resolve to the real final HTTP 200 page instead of being lost or excluded.
Respects robots.txt + noindex Prevents submitting private or forbidden admin pages to search engines, preserving search engine crawl budget.
Uses Canonical URL Over Crawled URL Avoids submitting parameter-heavy or duplicate URL variations, consolidating search ranking signals on the master page.
Automatic Split at 50,000 URLs / 50MB Matches Google's documented hard limits and automatically generates a master sitemap index file.
Retries + Timeout Resilience A single slow or unreachable page won't terminate or crash the entire sitemap generation run.
SIMPLE EXPLANATION

What Is a Sitemap, in Plain Words?

A sitemap is a simple file. It lists every page on your website. You give this file to search engines like Google, so they can find your pages faster and easier.

The Shopping Centre Analogy

Think of it like a map of a big shopping centre. Without a map, you might walk past some shops without knowing they are there. A sitemap works the same way for your website. It shows search engines where every page is, so nothing gets missed.

Official Google Documentation: "A sitemap tells search engines about pages, files, and other content on your site, and shows the relationships between them." [1]
ESSENTIAL BENEFITS

Why Do You Need a Sitemap?

A sitemap does not guarantee that search engines will use it. But it gives them a clear, reliable hint about every page you want them to know about. [1]

Helps search engines find your pages

New pages, or pages with very few links pointing to them, can be hard for search engines to find on their own. A sitemap points them straight to your new content.

Shows what changed

A sitemap can tell search engines when a page was last updated, so they know exactly when to revisit and recrawl your updated content.

Good for big websites

If your website has hundreds or thousands of pages, a sitemap makes sure none of them get left out or lost in deep navigation architecture.

Simple for small websites too

Even a small website with 10 pages benefits from having one clear list to ensure Google discovers every service, landing page, and contact option.

FEATURE HIGHLIGHTS

What This Tool Gives You

Clean, valid XML files built strictly according to search engine standards.

A Correct XML File

Your sitemap follows the standard format that search engines expect, so there are no errors when you submit it.

Works for Any Size Website

Add a few pages, or crawl thousands. The tool handles both quickly and seamlessly without freezing.

No Sign-Up Needed

Use the tool for free. No account, no email address, and no artificial limits on usage.

Ready to Submit

Download the file and upload it straight to your website. Then submit it to Google Search Console in just a few clicks.

Clear, Simple Output

The file is clean and easy to read, even if you want to inspect it yourself before uploading to your server.

QUICK WORKFLOW

Three Simple Steps

Building an XML sitemap takes less than 60 seconds from start to finish.

1

Add your page URLs

Type them in, paste a list, or let our automated 8-phase crawler scan your site and discover pages automatically.

2

Choose your settings

Pick how often each page changes and how important it is (this step is optional — search engines can still read the sitemap without them).

3

Download and submit

Download your sitemap.xml file, upload it to the root of your website, then tell Google and Bing where to find it.

BEST PRACTICES

Simple Rules to Follow

Clear, practical guidelines backed by official search engine rules and industry standards.

01

Keep file size under control

One sitemap file can only hold up to 50,000 URLs, and the file size must stay under 50MB when uncompressed. If your website is bigger, split it into multiple sitemaps using a sitemap index. [1]

02

Only include working pages

Do not add pages that show a 404 error, or pages that redirect to another URL. Including broken URLs can make search engines trust your sitemap less. [2]

03

Use UTF-8 encoding

This technical setting makes sure special characters, non-English scripts, and ampersands in your URLs display correctly without breaking search engine parsers. [1]

04

Keep your sitemap updated

Only update the lastmod date when the content actually changes. Updating dates without genuine changes can cause search engines to ignore your timestamps. [2]

05

Tell search engines where it is

Add a directive to your robots.txt file: Sitemap: https://yourwebsite.com/sitemap.xml. Then also submit it directly inside Google Search Console. [1]

06

Keep the sitemap on the same website

Your sitemap file should live on the same domain as the pages it lists (e.g. example.com/sitemap.xml for pages on example.com). Cross-domain submissions require additional ownership verification. [1]

AUDIENCE

Built For

Designed for anyone who wants their website discovered by Google without technical friction.

Small Business Owners

You don't need to know how to code. Add your pages, click generate, and get a working file in minutes.

Website Developers

Save time instead of writing the XML format by hand. Generate compliant sitemaps during staging or deployment.

SEO Beginners

Learn the basics of how search engines read your website with a tool that explains each step simply.

ANSWERS

Common Questions

Clear, direct answers to common questions about sitemaps and search engines.

A sitemap is a file that lists all the pages on your website. It helps search engines like Google find and understand your pages more easily.
The crawler begins by parsing robots.txt and existing sitemaps to capture orphan pages, then performs a breadth-first search (BFS) crawl with polite delays, following redirects, filtering out noindex tags, and resolving canonical URLs.
It still helps, even for a small website. But it becomes very important once your website has many pages, or pages that are hard to find through normal links.
No. A sitemap does not directly improve your ranking. It simply helps search engines find your pages. Good content and good website structure are still what helps you rank. [2]
Up to 50,000 URLs, and the file must be under 50MB when it is not compressed. If you have more pages than this, the tool automatically splits them and creates a sitemap-index.xml. [1]
Upload it to the main folder (root) of your website. For example: yourwebsite.com/sitemap.xml.
You can submit it inside Google Search Console under the "Sitemaps" section, or add a line to your robots.txt file so search engines can find it automatically. [1]
No. Submitting a sitemap is simply a strong hint to Google. It does not guarantee that every page will be crawled or indexed. [1]
XML is the most common and most widely supported format. Other formats like plain text are also accepted by Google. [1]
Yes. Many websites use a "sitemap index" file, which is just a list of several smaller sitemap files. This is common for very large websites.
Yes. No sign-up, no hidden cost, and no limit on how many times you use it.
GROWTH STACK

Related Marketing & Business Tools

Explore free calculators and growth engines built for modern businesses.

Authoritative Citations & Standards