Focused investigation and deliverable
Noindex and indexing-directive review
Review indexing directives against the intended publication state. Check both HTML meta robots and HTTP X-Robots-Tag headers; removing a visible noindex tag is insufficient if another response layer still supplies it.
What to investigate for this task
- Compare staging and production
- inspect response headers
- verify crawler access
Apply the distinction
Illustrative case: a launch inherits a staging header although the CMS setting says public. Correct the server rule and retest the live URL.
A useful deliverable and its acceptance check
Record the expected indexability of each template and its actual directives after release.
Continue with the relevant detail
- Crawlability and indexing — detailed guide
- Crawlability and indexing
- Relevant specialist service scope
Primary documentation
- developers.google.com · › search › docs › essentials › technical
- developers.google.com · › search › docs › crawling-indexing › block-indexing
- developers.google.com · › search › help › crawling-index-faq
Reviewed 1 November 2026. This page describes an investigation or editorial method. Agree access, implementation, data costs and responsibilities in the project scope; no proprietary data subscription, automated website changes or ranking guarantee is implied.
Your next move starts here
Make search a more useful part of your growth.
Start with your website. Leave with a clearer picture of what to improve, what to measure and where to focus next.