How to check an XML sitemap
- Enter the complete sitemap URL.
- Retrieve the file.
- Confirm whether it is a URL set or sitemap index.
- Review parsing and format findings.
- Inspect listed URLs or child sitemaps within the tool’s supported limits.
- Verify important URLs independently before changing indexation settings.
What is an XML sitemap?
An XML sitemap is a file that lists canonical URLs or points to child sitemap files. It helps crawlers discover locations the website wants to expose for crawling.
A sitemap does not guarantee crawling or indexing. URLs still need to be accessible, indexable, useful and consistent with other signals.
What should a sitemap checker report?
Depending on implementation, a report may show:
- Sitemap type
- HTTP status and final URL
- XML parsing errors
- Number of listed URLs or child sitemaps
- Invalid or missing location values
- Duplicate entries
- Last-modified format issues
- URLs on unexpected hosts
- Nested sitemap information
- Files that exceed supported tool limits
The checker should separate file-format observations from indexation conclusions.
URL set vs sitemap index
| URL set | Sitemap index |
|---|---|
| Lists webpage or resource URLs | Lists child sitemap files |
| Uses URL entries | Uses sitemap entries |
| Suitable for a manageable URL collection | Suitable for organizing multiple sitemap files |
| Each location should be a complete URL | Each child location should point to a sitemap |
What belongs in a sitemap?
A sitemap should normally list canonical URLs the website intends search engines to crawl and index. Avoid including:
- Redirecting URLs
- Error URLs
- Noindex pages
- Duplicate parameter variants
- Temporary staging URLs
- Noncanonical duplicates
- Removed pages
The sitemap must remain consistent with the site’s internal links, canonicals and indexation policy.
Last-modified dates
Use last-modified values only when they reflect meaningful page changes and can be maintained accurately. A current timestamp applied to every URL on every build provides little useful information.
The checker should validate format without claiming that a date guarantees faster crawling.
Sitemap declarations in robots.txt
A robots.txt file can declare sitemap locations. Use the Robots.txt Checker to see whether the expected sitemap is declared.
A declaration does not validate the sitemap or guarantee submission to a search engine.
Troubleshooting sitemap retrieval
Common problems include:
- The sitemap returns a redirect or error status
- The response is not XML
- The XML is malformed
- A child sitemap is unavailable
- URLs use the wrong host or protocol
- Listed locations redirect or return errors
- Compression or file size exceeds tool support
Use the HTTP Header Checker when you need to inspect the sitemap response status and headers.
Frequently asked questions
Does a valid sitemap guarantee indexing?
No. A sitemap supports discovery but does not guarantee crawling or indexing.
Should noindex pages be included?
Normally, a sitemap should contain canonical URLs intended for indexing. Including noindex pages sends conflicting intent.
Can a sitemap contain redirected URLs?
It can technically list them, but the preferred practice is to list the final canonical URLs rather than redirecting locations.
Is lastmod required?
No. Include it only when it can be generated and maintained accurately.
Can this tool check every URL in a large sitemap?
Only within the product’s stated limits. Large-scale status and indexability verification requires a crawler or external data source.