What XML Sitemap means
It aids discovery, particularly on large sites or where internal linking is weak. It doesn't guarantee indexing — it's a suggestion, not an instruction.
The lastmod field matters more than most teams realise: crawlers use it to prioritise re-fetching, so an accurate one speeds up how quickly changes register.
Why it matters for AI search
For AI search, discovery speed affects how current the retrievable version of your content is. A page crawled quarterly carries quarterly-old facts.
Sitemaps also expose problems: a large gap between submitted and indexed URLs is one of the clearest index bloat signals available.
See it in action
What a sitemap entry should contain.
Accurate lastmod is the field that earns trust.
Sites that update lastmod on every page nightly get their sitemap dates discounted. Reflecting genuine changes is what makes it useful.
How to get it right
Sitemap best practice
- Include only canonical, indexable URLs — no redirects, noindex pages or parameters
- Keep lastmod accurate and tied to real content changes
- Split into multiple sitemaps with an index file above 50,000 URLs
- Reference it from robots.txt and submit it in Search Console and Bing Webmaster Tools
- Compare submitted versus indexed counts regularly; a large gap indicates a problem
Common questions
Does a sitemap guarantee indexing?
No. It aids discovery but engines decide what to index. A URL in your sitemap that stays unindexed usually indicates a quality or duplication issue rather than a discovery one.
Should noindex pages be in the sitemap?
No. Including pages you don't want indexed sends contradictory signals and wastes crawl attention.
How often should lastmod update?
Whenever the page's content genuinely changes. Updating it site-wide on a schedule makes the field meaningless and it gets discounted.
Related concepts
These come up alongside XML Sitemap constantly.