How it works
Add <meta name='robots' content='noindex'> in the page head, or send an X-Robots-Tag: noindex header, which also works for PDFs and images [4].
Google has to crawl the page to see the rule, so the page must not be blocked by robots.txt [4]. A blocked page can still be indexed from links [3].
Once Google recrawls the page, it drops it from results. Pages left noindexed for a long time are eventually treated as if their links aren't followed either [4].
Why it matters
Not every page deserves to be in Google. Ahrefs found 96.55% of pages get no Google traffic at all [1]. Thin tag pages, internal search results, thank-you pages, staging copies and duplicate filters dilute a site and waste crawling. Noindex keeps them available to visitors while keeping search results focused on the pages that matter.
By the numbers
ways to apply noindex: a robots meta tag or an X-Robots-Tag header
Google Search Central: Block Search indexing with noindex[4]of pages get no Google traffic at all
Ahrefs search traffic study, Dec 2023[1]of reported crawl issues came from faceted navigation
Google Search Off the Record, episode 103, Feb 2026[2]Key components
Practical example
A Pune e-commerce store had thousands of internal search result pages indexed (like /search?q=red+kurta), many thin and near-duplicate. It added noindex to search result templates, kept them crawlable, and removed them from the sitemap. Within two months most dropped out of Google, and Search Console showed crawling shifting towards product and category pages.
Benefits and limitations
Benefits
- Keeps low-value pages out of search results.
- Pages stay usable for visitors.
- Works for non-HTML files via headers.
Limitations
- Takes effect only after Google recrawls the page.
- Doesn't work if robots.txt blocks the page [4].
- Not a security measure: the page is still public.
Tools and implementation
- Your CMS or SEO plugin: per-page noindex settings.
- Google Search Console: URL Inspection and 'Excluded by noindex'.
- Screaming Frog: find noindexed pages at scale.
- Search Console Removals tool: temporary urgent removal.
Common mistakes
- Blocking a page in robots.txt and adding noindex [4].
- Leaving a site-wide noindex on after launch.
- Noindexing pages that are canonical targets.
- Listing noindexed pages in the XML sitemap.
- Using noindex to hide private data instead of passwords.
Related glossary terms
Our SEO services in Pune decide which pages belong in Google, and our website design and development services apply noindex rules safely in your templates. Further reading: how to choose an SEO company in Pune.
Get a free consultationFrequently asked questions
How do I add a noindex tag?
Add <meta name='robots' content='noindex'> to the page head, or send an X-Robots-Tag: noindex HTTP header. Most SEO plugins have a simple setting [4].
Why is my noindexed page still in Google?
Google hasn't recrawled it yet, or robots.txt blocks it so Google can't see the tag [4]. Use URL Inspection to request a recrawl.
Should I use noindex or robots.txt?
Use noindex to keep a page out of results. Use robots.txt to stop crawling of areas that don't need to be crawled. Don't combine them on the same page.
Which pages should I noindex?
Thank-you pages, internal search results, thin tag archives, staging copies and private-but-public utility pages are common candidates.
Sources
- Ahrefs search traffic study (Dec 2023). Cross-checked with: Ahrefs SEO statistics roundup (same publisher).
- Google Search Off the Record, episode 103 (Feb 2026). Cross-checked with: Search Engine Land.
- Google Search Central: Introduction to robots.txt (Current doc). Cross-checked with: Google: How Google interprets the robots.txt specification.
- Google Search Central: Block Search indexing with noindex (Current doc). Cross-checked with: Ahrefs glossary: Noindex tag (Mueller on long-term noindex).
Last updated: 18 November 2026. Every statistic on this page links to its original source and was cross-checked against a second source where one was available.
