What is IndexNow?
IndexNow is an open protocol that lets websites instantly notify search engines about new or updated content. Instead of waiting for a crawler to find your changes on its own schedule, you push the URL directly to the search engine and the engine prioritizes crawling it. Sight AI uses IndexNow to submit your URLs to Bing. Bing relays each submission to every other participating engine, so a single ping reaches:- Bing — Microsoft’s search engine
- Yandex — Russia’s largest search engine
- Seznam — Czech Republic’s search engine
- Naver — South Korea’s largest search engine
Google does not participate in IndexNow. For Google indexing, use the Google Search Console integration. Run both in parallel for full search-engine coverage.
Setup
The full setup walkthrough — including hyper-specific instructions for custom sites on Vercel, Netlify, Cloudflare Pages, GitHub Pages, Apache, Nginx, IIS, S3, Shopify, Ghost, and more — lives in the dedicated integration guide:Bing IndexNow Integration Setup
Generate your key, host the verification file at your site root, and verify — with platform-specific instructions for every major hosting setup and a deep troubleshooting section for every error message.
Generate a key in Sight AI
Go to Integrations → Bing IndexNow, pick your workspace, and click Generate IndexNow key. Sight AI creates a 32-character key and a downloadable
.txt file for you.Host the key file at your site root
Upload the file so it’s reachable at
https://yourdomain.com/<your-key>.txt and returns the key as plain text. The exact “how” depends on your hosting platform — see the integration guide for step-by-step instructions per platform.How submissions work after setup
Once verified, IndexNow runs in the background. You don’t need to do anything else.What gets submitted
- New URLs in your sitemap — picked up during Sight AI’s hourly sitemap check
- Articles you publish through Sight AI — submitted the moment they sync to your CMS
- Updated URLs — re-submitted when the URL appears in your sitemap with a new
lastmod
host— your verified domainkey— the IndexNow key Bing already verified you ownkeyLocation— the URL of your key file (so Bing can re-verify on demand)urlList— up to 10,000 URLs per submission
Manual submissions
You don’t usually need to submit URLs manually because the automation covers everything, but if you want to ping a specific URL right now, the Sight AI Indexing Activity page shows a Submit URL action.Monitoring
Every submission is recorded with a status, response code, and timestamp. View them in Indexing Activity:- Recent submissions and their batch IDs
- HTTP status from Bing’s IndexNow endpoint
- URLs included in each batch
- Error messages for any failed submissions
Limits & expectations
- No rate limits to worry about — Sight AI batches submissions and Bing accepts up to 10,000 URLs per request
- Bing acks the submission instantly — but actual indexing still takes hours to a day or two
- IndexNow is a notification, not a guarantee — Bing will only index pages it considers crawlable and quality content; low-quality, blocked, or duplicate pages won’t appear regardless
Disconnecting
To turn off IndexNow:- Go to Integrations → Bing IndexNow
- Click Disconnect
- Confirm
Troubleshooting
Most issues come up at the verification step. The integration guide’s troubleshooting section walks through every error message Sight AI surfaces — from “key file not accessible” through TLS errors, WAF blocks, and content mismatches — with the exact fix for each. If submissions are passing verification but the Indexing Activity page still shows failures, the most common cause is a host mismatch: your sitemap URLs use a different host (apex vswww, or a different subdomain) than the one you verified. Make your sitemap consistent with the verified host.
Next steps
- Set up the integration — full step-by-step setup
- Monitor indexing activity — see every submission and its outcome
- Set up Google Search Console — for Google indexing
- Learn how Sight AI handles indexing overall