What Is a Noindex Tag?

The noindex tag explained: how to keep pages out of Google, meta tag versus X-Robots-Tag, why robots.txt blocks break it and which pages to noindex.

Updated: 18 November 2026Also known as: Noindex, Meta robots noindex, X-Robots-Tag noindex4 min read

Get Free Consultation

Speak with our Digital Marketing Expert today.

Quick definitionA noindex tag tells search engines not to include a page in their results. It's set with a robots meta tag in the page's HTML or an X-Robots-Tag in the HTTP response.

How it works

Add <meta name='robots' content='noindex'> in the page head, or send an X-Robots-Tag: noindex header, which also works for PDFs and images [4].

Google has to crawl the page to see the rule, so the page must not be blocked by robots.txt [4]. A blocked page can still be indexed from links [3].

Once Google recrawls the page, it drops it from results. Pages left noindexed for a long time are eventually treated as if their links aren't followed either [4].

Why it matters

Not every page deserves to be in Google. Ahrefs found 96.55% of pages get no Google traffic at all [1]. Thin tag pages, internal search results, thank-you pages, staging copies and duplicate filters dilute a site and waste crawling. Noindex keeps them available to visitors while keeping search results focused on the pages that matter.

By the numbers

2

ways to apply noindex: a robots meta tag or an X-Robots-Tag header

Google Search Central: Block Search indexing with noindex[4]
96.55%

of pages get no Google traffic at all

Ahrefs search traffic study, Dec 2023[1]
About 50%

of reported crawl issues came from faceted navigation

Google Search Off the Record, episode 103, Feb 2026[2]

Key components

Meta robots tagIn the HTML head of a page.
X-Robots-TagIn the HTTP header, for any file type.
Crawl accessThe page must be crawlable for the rule to work.
RecrawlGoogle must revisit the page before it drops out.
Combined rulesSuch as noindex, nofollow or none.

Practical example

A Pune e-commerce store had thousands of internal search result pages indexed (like /search?q=red+kurta), many thin and near-duplicate. It added noindex to search result templates, kept them crawlable, and removed them from the sitemap. Within two months most dropped out of Google, and Search Console showed crawling shifting towards product and category pages.

Benefits and limitations

Benefits

  • Keeps low-value pages out of search results.
  • Pages stay usable for visitors.
  • Works for non-HTML files via headers.

Limitations

  • Takes effect only after Google recrawls the page.
  • Doesn't work if robots.txt blocks the page [4].
  • Not a security measure: the page is still public.

Tools and implementation

Common mistakes

Our SEO services in Pune decide which pages belong in Google, and our website design and development services apply noindex rules safely in your templates. Further reading: how to choose an SEO company in Pune.

Get a free consultation

Frequently asked questions

How do I add a noindex tag?

Add <meta name='robots' content='noindex'> to the page head, or send an X-Robots-Tag: noindex HTTP header. Most SEO plugins have a simple setting [4].

Why is my noindexed page still in Google?

Google hasn't recrawled it yet, or robots.txt blocks it so Google can't see the tag [4]. Use URL Inspection to request a recrawl.

Should I use noindex or robots.txt?

Use noindex to keep a page out of results. Use robots.txt to stop crawling of areas that don't need to be crawled. Don't combine them on the same page.

Which pages should I noindex?

Thank-you pages, internal search results, thin tag archives, staging copies and private-but-public utility pages are common candidates.

Sources

  1. Ahrefs search traffic study (Dec 2023). Cross-checked with: Ahrefs SEO statistics roundup (same publisher).
  2. Google Search Off the Record, episode 103 (Feb 2026). Cross-checked with: Search Engine Land.
  3. Google Search Central: Introduction to robots.txt (Current doc). Cross-checked with: Google: How Google interprets the robots.txt specification.
  4. Google Search Central: Block Search indexing with noindex (Current doc). Cross-checked with: Ahrefs glossary: Noindex tag (Mueller on long-term noindex).

Last updated: 18 November 2026. Every statistic on this page links to its original source and was cross-checked against a second source where one was available.