Bulk Meta Robots Checker
Check meta robots tags in bulk for up to 50 URLs. Noindex, nofollow and other directives listed per page, including X-Robots-Tag headers. CSV export.
Bulk Meta Robots Checker
One stray "noindex" can erase a page from Google without any visible change on the page itself. This checker reads the meta robots tag — and the X-Robots-Tag header most tools ignore — across up to 50 URLs, and shouts about every noindex it finds.
How to use
- Paste your URLs, one per line.
- Click "Check Robots Tags".
- Treat every NOINDEX row on an important page as an emergency until proven deliberate.
- Check the conflict flags — pages where the header and the meta tag disagree.
- Fix mistakes in your CMS or server config.
- Re-run the check and export the clean CSV as your record.
Tips
- After any staging-to-live migration, run this check first — staging noindex tags are the classic launch-day disaster.
- Remember the header version exists: a page can be noindexed by X-Robots-Tag with no meta tag at all.
- Deliberate noindex (thank-you pages, internal search results) is fine — the goal is no surprises.
Frequently asked questions
How many URLs can I check at once?
Up to 50 per run.
What is the X-Robots-Tag?
An HTTP response header that carries the same directives as the meta robots tag. It also works for PDFs and images, which have no HTML head.
Which directive matters most?
noindex — it removes the page from search results. nofollow only concerns the links on the page.
What does "no tag found" mean?
The page has no robots restrictions — the default is indexable. That is the normal state for public pages.
What is a conflict?
The meta tag and the header giving different instructions (for example, meta says nothing, header says noindex). The stricter instruction wins in practice, so conflicts need fixing.
Can this checker see JavaScript-injected tags?
No — it reads the server's HTML response, which is also what most crawlers rely on first. Check rendered output in your browser if your site injects tags.
Can I export results?
Yes, full table to CSV.
Is my URL list stored?
No, processed for the check and discarded.
Why did a URL error?
Down, protected or slow — verify in a browser before acting.
Is this tool free?
Yes — free, no sign-up, fair-use limit of 10 requests per minute.