Bot identification

Meet the SitemapChecker bot

If you found this page in your server logs, a request from SitemapChecker/1.0 (+https://sitemapcheck.app/bot) visited your site. Here's why and what to do about it.

User-Agent

Every outbound request the service makes carries this exact User-Agent header:

SitemapChecker/1.0 (+https://sitemapcheck.app/bot)

What it does

  • • Fetches your sitemap XML when a check is requested for your site.
  • • Discovers child sitemaps from sitemap-index files and from robots.txt.
  • • Visits every URL listed in the sitemap. By default these are HEAD requests (status check only). For "Cache warmup" or SEO extraction, full GET requests are used so the response body is read.
  • • Collects status code, response time, redirect target, and cache headers (Cache-Control, Age, CF-Cache-Status, etc.).

When it visits

Only when a user of sitemapcheck.app asks for a check:

  • • A one-off check submitted from the homepage form.
  • • A scheduled check (as often as every 30 minutes, up to monthly) configured by a user who registered your sitemap.

There is no autonomous crawling — the bot does not follow internal links and does not visit URLs that aren't in a submitted sitemap.

Politeness

  • • Configurable delay between requests (500–5000 ms, default 1000 ms).
  • • Configurable concurrency per check (1–10 simultaneous requests).
  • • Hard URL caps per check based on the user's plan (between 500 and 10,000 URLs).
  • • HEAD by default for plain status checks — only GET when the user explicitly opted in to cache warmup or SEO metadata extraction.

How to block the bot

If someone added your sitemap to a scheduled check and you'd rather they didn't, you have a few options:

  1. Block by User-Agent at your edge / WAF / web server. Match the literal string above and return 403.
  2. Add a robots.txt rule. Honoured for sitemap discovery (when looking up Sitemap: entries):
    User-agent: SitemapChecker
    Disallow: /
  3. Email [email protected] with the domain and we'll remove any scheduled checks pointed at it.

Questions?

Reach us at [email protected]. We reply within one business day.