Keep a page out of Google
Short answer
To keep a page out of Google Search, use noindex and leave the page crawlable. robots.txt alone can't do it, because Google must crawl the page to see noindex. For permanent removal, delete or protect the content; the Removals tool hides a page within a day, but only for about six months.
Before you start
Section titled “Before you start”- Decide what you want: not shown in Google (noindex), not accessible to anyone (protect or delete), or gone fast (Removals tool, plus one of the others).
- Find every URL variant that serves the content (with and without parameters, different cases).
1. Use noindex, not robots.txt
Section titled “1. Use noindex, not robots.txt”<meta name="robots" content="noindex">X-Robots-Tag: noindex2. Leave the page crawlable
Section titled “2. Leave the page crawlable”3. Need it gone quickly?
Section titled “3. Need it gone quickly?”Verify
Section titled “Verify”- Use Search Console’s URL Inspection tool to confirm Google sees the
noindexand is not blocked by robots.txt. - Re-check after Google recrawls the page; until then the old result may still show.
Rollback
Section titled “Rollback”Remove the noindex rule and request indexing in URL Inspection.
Common mistakes
Section titled “Common mistakes”- Adding
noindexand disallowing the page in robots.txt — the disallow hides thenoindex. - Relying on the Removals tool alone — the page returns after about six months.
- Using
noindexto limit AI Overviews while wanting to stay in Search. For that, use snippet controls instead (Snippet controls for AI Overviews and AI Mode).