A noindex tag is an instruction that tells search engines not to show a page in their results. Google can still crawl the page, but once it sees the rule, it drops that URL from search.
It is the right tool for pages that need to exist but shouldn't be found through search, such as thank-you pages or internal search results. It is also a common cause of accidental traffic loss when it ends up on the wrong pages.
What is a noindex tag?
Noindex is a robots directive that can be delivered in two ways, according to Google Search Central:
- A robots meta tag in the page's head section, such as a meta element with name="robots" and content="noindex". Using name="googlebot" instead targets only Google.
- An X-Robots-Tag HTTP header with the value noindex. This works for non-HTML files like PDFs, images and videos.
Both have the same effect. Noindex controls indexing, not crawling, and it can be combined with other rules such as nofollow. The value "none" is shorthand for noindex plus nofollow, per Google's robots meta tag reference.
Why noindex matters
Not every page deserves a spot in search results. Login pages, cart pages, staging copies, thin tag archives and campaign landing pages meant only for paid traffic can clutter your search presence. Noindex lets you keep them live for users while keeping them out of results.
The flip side is risk. A noindex tag left on a template after a redesign can remove whole sections of a site from Google. Since many AI search tools lean on search indexes, a page Google drops is also less likely to surface in AI answers.
How noindex works
Google has to crawl the page to see it
This is the key point. Google only learns about a noindex rule when it fetches the page. If you also block that page in robots.txt, Googlebot never sees the tag, and the URL may still appear in results if other pages link to it. Google also does not support noindex as a rule inside robots.txt.
Removal takes a recrawl
The page leaves results after Google recrawls it, which Google says can take months for less important pages. You can speed things up by requesting a recrawl with the URL Inspection tool in Search Console, or use Google's removals tool for urgent cases.
JavaScript can't reliably undo it
Google's JavaScript SEO guide warns that when Google sees noindex in the original HTML, it may skip rendering. So a script that removes the tag later may never run. If you want a page indexed, keep noindex out of the initial HTML.
How to use noindex correctly
- Pick the right pages. Good candidates include thank-you pages, internal search results, account pages and thin archive pages.
- Leave the page crawlable. Do not block a noindexed URL in robots.txt.
- Remove it from your sitemap. Your XML sitemap should list only pages you want indexed.
- Use the header for files. Apply X-Robots-Tag to PDFs and other non-HTML resources.
- Check after launches. Review the Page Indexing report in Search Console for pages "Excluded by 'noindex' tag" and confirm every one is intentional.
Common mistakes
- Shipping a staging noindex to production. Many CMSs have a "discourage search engines" setting that is easy to forget.
- Using noindex to save crawl budget. Google still has to request the page to see the tag, so it doesn't save crawl budget, per Google's crawl budget guide.
- Mixing noindex with a canonical tag. Pointing a canonical tag at another URL while also using noindex sends mixed signals. Pick one approach for duplicates.
- Assuming every engine behaves the same. Google notes other search engines may interpret noindex differently.
How Butter approaches noindex
At Butter, checking noindex rules is part of the indexing strategy we review each month. We compare the pages excluded in Search Console against the pages you actually want found, and flag anything that looks accidental. On the GEO+SEO plan, fixing misplaced noindex tags falls under the technical SEO work we handle. We also make sure noindexed pages are kept out of your sitemap. It is a small detail, but making sure your best pages are indexable comes before any other search or AI visibility work.
Frequently asked questions
What is the difference between noindex and disallow?
Disallow in robots.txt stops crawling, while noindex stops indexing. A disallowed page can still appear in results if other sites link to it. To keep a page out of results, allow crawling and use noindex.
How long does it take for a noindexed page to disappear from Google?
It disappears after Google recrawls the page and sees the rule. That can be days for important pages or months for rarely crawled ones. Requesting a recrawl in the URL Inspection tool can help.
Will noindex hurt the rest of my site?
No, as long as it is on the right pages. Noindexing low-value pages only affects those URLs. Problems start when it is applied by accident to pages you want to rank.