Google-CloudVertexBot: What It Does and How to Control It
Google Cloud's crawler that fetches content for Vertex AI Search services and customer-built search deployments on Google Cloud.
What happens if you allow or block it
Your pages can be indexed and cited in the vendor's search and AI answers.
your pages cannot be retrieved by Vertex AI Search experiences that rely on crawling your site.
The robots.txt rule
This is the exact rule auditme.dev publishes for Google-CloudVertexBot:
User-agent: Google-CloudVertexBot Allow: / Disallow: /auth/ /_next/ /private/ /dashboard /settings /profile Disallow: ... (25 more paths)
The full path list lives in our robots.txt.
Frequently Asked Questions
Is Google-CloudVertexBot allowed on auditme.dev?
Yes. Our robots.txt explicitly allows Google-CloudVertexBot to crawl public pages while keeping private areas (auth, dashboard, internal APIs) disallowed.
Does blocking Google-CloudVertexBot hurt Google rankings?
No. Google-CloudVertexBot is Google Cloud's crawler and works independently from Googlebot. Blocking it never changes your Google rankings — it only changes your pages cannot be retrieved by Vertex AI Search experiences that rely on crawling your site.
How do I allow or block Google-CloudVertexBot on my own site?
Add a "User-agent: Google-CloudVertexBot" block to your robots.txt with Allow or Disallow rules, then verify the file parses correctly.