Indexing Activity & Monitoring

​

Overview

Sight AI continuously monitors your sitemap, submits new URLs to search engines, and logs every event so you can audit what’s happening. The Indexing Activity page is the audit trail. It lives at app.trysight.ai/indexing/activity. The Sitemap status page is its sibling at /indexing/sitemap.

​

What’s New

The Indexing Activity page was rewritten in April 2026 to fix several count and redirect bugs and to add:

• Stats strip — totals for submissions, detections, and connections in the lookback window
• Type filter — filter to Submissions / Detections / Connections / All
• Status filter — filter to Success / Failed / All
• Free-text search — find activity by URL or source
• Pagination — browse the full 90-day history without scrolling forever
• Per-row drill-down — click any submission row to see exactly which URLs were submitted

If you’re an existing user, the new page is a drop-in replacement at the same nav location (“Indexing → Activity”).

​

Activity Types

Every entry on the page is one of: Use the type filter chips at the top of the page to narrow down to one category.

​

Status

Each entry has one of three statuses: Use the status filter to surface only failures when you’re debugging.

​

Reading a Row

Each row shows:

• Title — what happened (e.g., “Submitted 5 URLs to Google”, “Detected 12 new URLs”)
• Description — context (e.g., the source CMS, the property URL, the error message)
• Timestamp — relative (“2 hours ago”) and absolute on hover
• URL count — for submissions and detections, the number of URLs involved (normalized across the various backend field names)
• Drill-down — for rows where individual URLs are tracked (new URLs detected, IndexNow submissions), click to expand and see the URL list

​

Sitemap Status

The companion Sitemap page (/indexing/sitemap) shows:

• Total URLs — number of URLs currently in your sitemap
• Last Checked — when the sitemap was last scanned
• Next Crawl — when the next scheduled scan will run
• New This Week — URLs detected in the past 7 days
• Pending Submissions — URLs waiting to be submitted

A historical chart shows URL count over time so you can spot sudden drops or spikes.

​

Monitoring Schedule

Sight AI checks your sitemap on a regular schedule:

• Hourly checks — quick scan for new URLs
• Daily full sync — complete sitemap comparison
• On-demand — immediate check when you publish via Sight AI

​

Manual Refresh

To trigger an immediate sitemap check:

1. Go to Indexing → Sitemap
2. Click “Refresh Now”
3. Sight AI will scan your sitemap immediately
4. New URLs will be detected and submitted, and the events will appear in the Activity page

​

Troubleshooting

​

New URLs Not Being Detected

• Verify the URLs are in your sitemap
• Check that the sitemap URL is correct in Site Settings
• Ensure the sitemap is accessible (no auth required)
• Try a manual refresh on the Sitemap page

​

Sitemap Errors

• Validate your sitemap XML at XML sitemap validator
• Check for encoding issues
• Ensure URLs use consistent formatting
• Look for duplicate entries

​

Submission Failures

• Use the status filter on the Activity page to surface only failures
• Click into a failed row to see the underlying error message
• Common causes: GSC token expired (reconnect), IndexNow key file missing (re-verify), or the URL returned a non-200 to the search engine’s crawl

​

Stale Monitoring Data

• Check when the last check occurred on the Sitemap page
• Try a manual refresh
• Verify your site is accessible
• Contact support if issues persist

​

Best Practices

• Keep sitemap updated — ensure your CMS updates it automatically
• Filter to “Failed” weekly — a 30-second scan catches indexing problems before they become traffic problems
• Use lastmod dates — help Sight AI identify updated content for re-submission
• Use the search box to confirm a specific URL was submitted (paste the slug)

​

Next Steps

• Submit sitemap to Google
• Set up IndexNow for Bing
• Connect Google Search Console