Introducing Sitemap Monitoring: Know Every URL That Enters or Leaves Your Sitemaps

Your XML sitemap is the list you hand search engines of the pages you want found. On most sites, nobody writes it. A plugin, a build script or a CMS setting generates it, every deploy can change it, and nobody looks at it again until something has gone wrong.

Starting today, VitalSentinel looks at it every day. Sitemap Monitoring is live on every plan, including Free, and it has no plan limits on sitemaps or URLs. It finds your sitemaps, reads each one once a day, and tells you what changed and whether it matters.

The Problem With a File Nobody Reads

I have seen the same story on client sites more times than I would like. A release changes a template, and a whole category quietly drops out of the product sitemap. A plugin update starts writing every date as today's date. A sitemap file starts returning an error, and search engines stop reading it. A sitemap grows past 50,000 URLs, and everything after that line is ignored.

None of these break the site. Visitors notice nothing, your uptime monitor stays green, and the first sign is usually a traffic report weeks later. By then, the question "what was in the sitemap last month?" has no answer, because nobody kept a copy.

Nothing to Set Up

There is no setup step. Add a domain and the first check starts right away. There is nothing to install and no ownership verification. Sitemaps are found for you, from four places:

• The Sitemap: lines in your robots.txt
• The sitemaps you submitted in Google Search Console, if it is connected
• Common locations such as /sitemap_index.xml and /sitemap.xml
• Every sitemap listed in a sitemap index they lead to, compressed ones included

From then on, every file is downloaded and read once a day, on every plan.

What Changed, URL by URL

Each check is compared with the one before. Every URL in the comparison gets a plain label: New, Removed, Back in sitemap or Updated. On top of that, it flags the patterns that usually mean a generator is misbehaving: a date that went backwards, a date in the future, sitemaps that disagree on a URL's date, and URLs that keep coming and going.

The Overview opens on a Sitemap health card that leads with the problems worth fixing, in sentences rather than codes. Under it, URLs over time charts how many URLs your sitemaps list each day, with new and removed URLs as bars, and you can pick any day to see what changed on it. What changed breaks a check down into tiles and a table, with each URL's sitemap file, last-modified date and last status.

Removed, but Still Getting Clicks

Not every removal is a problem. Sites retire pages all the time, and a URL leaving the sitemap is often exactly what should happen.

A URL that leaves the sitemap while Google is still sending it traffic is different. That is usually a mistake, and it is the one thing I most wanted this module to catch. Connect Search Console and every removed URL is set against its Google clicks from the last 90 days. The ones that were still earning come first, under Still getting clicks, each with a suggested next step: redirect it, add it back, or check the redirect.

No False Alarms

A sitemap monitor that panics every time a server hiccups is worse than none, so two rules keep this one honest.

If a file cannot be downloaded or read, its URLs are held, not counted as removed. A flaky server does not turn into a thousand false removals. And when a check sees a large drop, the file is downloaded again an hour later before anything is reported. If the drop is real, the report says it was confirmed by the second download.

Limits and Rules, Checked for Every File

Search engines are strict about sitemaps, and quiet about it when you break the rules. So every file is checked against them: the 50,000 URL and 50 MB limits, URLs that are not full addresses or sit on another host, dates not in W3C format, a sitemap index inside an index, and the image, video, news and hreflang tags.

Each finding is marked Over limit, Error, Close to limit or Recommendation, and opens with the rule, how to fix it, and a link to the source. "Close to limit" is there so you hear about a growing file before it crosses the line, not after.

The Files tab lists every sitemap file with whether it was read, how many URLs it lists and how that changed, where it was found, and when it last downloaded cleanly.

A Sitemap Is Only as Good as Its URLs

A sitemap that lists redirects, 404s and pages Google refuses to index is sending mixed signals. The URLs tab shows every URL in your sitemaps next to what the rest of VitalSentinel knows about it:

• What our crawl found: a redirect, a 404, a noindex, or a canonical pointing at another page
• Whether the URL is in Google's index, and Google's reason if it is not, from Indexing Monitoring
• When Googlebot last visited, from Server Log Monitoring
• How many Google clicks it earned, from Search Console

Each view fills in as the matching module is connected, so the more of VitalSentinel you use, the more each sitemap URL tells you.

Alerts, on Your Terms

There are eight alert rules, and none is switched on until you add it, so you only hear about what you care about:

• Sitemap file fails to load
• URLs removed that still get clicks
• Sitemap shrinks
• Sitemap grows
• New URLs added
• Removed URLs listed again
• Dates rewritten on every check
• Sitemap file added or removed

For a shrinking or growing sitemap you set the percentage yourself. Alerts arrive in the app and, if you want, by email. The alert reference describes each one.

Every Plan, No Plan Limits

Sitemap Monitoring works the same on every plan, Free included. No plan limits the number of sitemaps or URLs, every plan is checked daily, and history goes back 12 months. It is also reachable through the public API and MCP tools, so "Did any URLs leave my sitemap this week?" is now a question you can just ask your assistant.

Where to Start

Open any domain you already monitor and choose Sitemap Monitoring in the sidebar. The first check has most likely run already. The Sitemap Monitoring guide explains every screen, and the feature page has the overview.

Your sitemap is the list of pages you are asking Google to care about. Now there is a record of what was on it, and a heads-up the day that changes. Have a look at what left your sitemaps this week, and tell me what you find.