AI crawler

Google-Extended

Also: Google Extended, Gemini training control

Blocking Google-Extended opts a site out of Gemini app and Vertex AI use. It does not remove the site from AI Overviews or AI Mode and is not a ranking signal. No explicit Allow is needed, because a token with no matching rule is allowed by default.

To keep a site's content out of AI Overviews and AI Mode, Google offers a separate Search generative AI control in Search Console, available worldwide since 31 Aug 2026.

Sources

  • Google documents Google-Extended as a standalone product token that does not affect a site's inclusion in Google Search (Google Search Central, "Google's common crawlers").
  • The Search generative AI control in Search Console, worldwide since 31 Aug 2026, excludes a site from AI Overviews, AI Mode and Discover AI (Google Search Console Help).

Related