Google-Extended

What it controls

Google-Extended is “a standalone product token”. It lets publishers manage whether content Google crawls from their sites may be used to train future generations of Gemini models. Those models power Gemini Apps and the Vertex AI API for Gemini. The token also covers grounding in Gemini Apps and Grounding with Google Search on Vertex AI.

Officially documented · Google

What it does not control

“Google-Extended does not impact a site’s inclusion in Google Search nor is it used as a ranking signal in Google Search.”

Officially documented · Google

AI Overviews and AI Mode are part of Google Search. To keep a site out of them, use the Search generative AI control. To limit what they show from a page, use snippet controls (Snippet controls for AI Overviews and AI Mode).

Search Console Help describes the same division from the other side. It says the Search generative AI control “doesn’t affect AI training; to limit training of the models used to generate responses in Search generative AI features, use Google-Extended.”

Officially documented · Google Search Console Help

Google’s crawler documentation lists Google-Extended’s scope as Gemini Apps and Vertex AI. The Search Console help article also names the models behind Search’s generative AI features. Neither says Google-Extended removes content from those features.

No separate crawler

Google-Extended has no HTTP user-agent string of its own. Crawling is done with existing Google user agents, and the token is only read from robots.txt “in a control capacity”.

Officially documented · Google

You will not see “Google-Extended” in server logs. You also cannot block it at the firewall by user agent.

Usage

user-agent: Google-Extended
disallow: /

Rules follow normal robots.txt syntax, so partial opt-outs (allow / disallow by path) work too.

See also

• Configure robots.txt for AI crawlers — Google-Extended alongside GPTBot, OAI-SearchBot and others.