Monitoring Your Sitemap

Track how Sight AI monitors your sitemap and detects new content.

Overview

Sight AI continuously monitors your sitemap to detect new content and submit it to search engines. This page explains how monitoring works and how to track the status of your indexing efforts.

Monitoring Schedule

Sight AI checks your sitemap on a regular schedule:

  • Hourly checks – Quick scan for new URLs
  • Daily full sync – Complete sitemap comparison
  • On-demand – Immediate check when you publish via Sight AI

What's Monitored

New URLs

URLs that appear in your sitemap for the first time. These are automatically submitted to enabled search engines.

Updated URLs

URLs with changed lastmod dates in the sitemap. These indicate content updates that search engines should re-crawl.

Removed URLs

URLs that were previously in your sitemap but are now gone. Sight AI tracks these but doesn't take automatic action.

Viewing Monitoring Status

Dashboard View

From your site dashboard, you can see:

  • Total URLs – Number of URLs in your sitemap
  • Last Checked – When the sitemap was last scanned
  • New This Week – URLs detected in the past 7 days
  • Pending Submissions – URLs waiting to be submitted

Detailed View

For more details:

  1. Go to Site Settings → Indexing
  2. View the Sitemap Status section
  3. See recent detections and submissions
  4. Check for any errors or issues

URL Status

Each detected URL has a status:

StatusDescription
DetectedNew URL found, pending submission
SubmittedSent to search engines
IndexedConfirmed indexed by search engine
ErrorIssue with submission or URL

Alerts and Notifications

Sight AI can alert you about:

  • Sitemap errors – Invalid XML or access issues
  • Submission failures – Problems sending to search engines
  • Large changes – Significant URL additions or removals

Manual Refresh

To trigger an immediate sitemap check:

  1. Go to Site Settings → Indexing
  2. Click "Refresh Now"
  3. Sight AI will scan your sitemap immediately
  4. New URLs will be detected and submitted

Sitemap History

View historical data about your sitemap:

  • URL count over time
  • Detection history
  • Submission history
  • Error history

Troubleshooting

New URLs Not Being Detected

  • Verify the URLs are in your sitemap
  • Check that the sitemap URL is correct in settings
  • Ensure the sitemap is accessible (no auth required)
  • Try a manual refresh

Sitemap Errors

  • Validate your sitemap XML at XML sitemap validator
  • Check for encoding issues
  • Ensure URLs use consistent formatting
  • Look for duplicate entries

Stale Monitoring Data

  • Check when the last check occurred
  • Try a manual refresh
  • Verify your site is accessible
  • Contact support if issues persist

Best Practices

  • Keep sitemap updated – Ensure your CMS updates it automatically
  • Check weekly – Review monitoring status regularly
  • Fix errors quickly – Address any sitemap issues promptly
  • Monitor URL count – Sudden changes may indicate problems
  • Use lastmod dates – Help Sight AI identify updated content

Next Steps