What Google-Extended means
Google-Extended is a control token rather than a crawler. Googlebot does the crawling; Google-Extended governs whether that content can be used for Gemini and related generative products.
Critically, disallowing it does not affect your Google Search rankings. That separation is deliberate and it's the thing most teams get wrong.
Why it matters for AI search
Many sites disallowed Google-Extended during the initial wave of AI-crawler caution and never revisited the decision. That removes them from Gemini consideration entirely while gaining nothing in Search.
If you want AI visibility inside Google's ecosystem, this is a one-line prerequisite.
See it in action
Two directives, two completely different consequences.
Rankings genuinely don't change either way.
This is the cleanest decision in AI SEO: allowing it costs you nothing in Search and is the precondition for Gemini visibility. Publishers monetising content still have a legitimate case for opting out.
How to get it right
Setting it deliberately
- Check whether your robots.txt currently disallows Google-Extended
- Understand it's separate from Googlebot — disallowing doesn't protect rankings, it just removes AI eligibility
- Decide based on your business model rather than inherited caution
- If you allow it, verify with a fetch rather than assuming the file is correct
- Document the decision so it isn't reversed by someone applying a blanket AI rule later
Common questions
Does blocking Google-Extended hurt our rankings?
No. It's explicitly separate from Googlebot. Your Search rankings are unaffected either way.
What it removes is eligibility for Gemini grounding and AI Overview citation.
Should we allow it?
Most brands wanting AI visibility should, since disallowing removes you from consideration entirely at no ranking benefit.
Publishers monetising content directly have a genuine case for restricting. Either way it should be deliberate.
Is Google-Extended a crawler?
No, it's a control token. Googlebot does the crawling; Google-Extended determines how that content may be used downstream.
That's why you won't see it in server logs as a distinct user agent.
Related concepts
These come up alongside Google-Extended constantly.