← AI crawler directory

// Google

Googlebot

IndexingPublished CIDRsVerified July 2026

// Overview

What it is

Googlebot crawls and renders pages for Google Search indexing, including surfaces that supply search results to AI features. Aiola classifies it as indexing because it supports a searchable retrieval index.

In Aiola's taxonomy, Indexing means crawled for ai or search indexing.

// Headers

User agent

Look for the match token inside the complete HTTP User-Agent header. Tokens can be spoofed, so use the network checks below for authentication.

Full example User-Agent
Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
Case-insensitive match token
Googlebot

// Network

Official IP ranges

Google publishes an official JSON feed. This cached snapshot contains 315 CIDR prefixes, last fetched 2026-07-11. Open the live source ↗

Googlebot CIDRs — snapshot fetched 2026-07-11
192.178.4.0/27
192.178.4.128/27
192.178.4.160/27
192.178.4.192/27
192.178.4.224/27
192.178.4.32/27
192.178.4.64/27
192.178.4.96/27
192.178.5.0/27
192.178.6.0/27
192.178.6.128/27
192.178.6.160/27
192.178.6.192/27
192.178.6.224/27
192.178.6.32/27
192.178.6.64/27
192.178.6.96/27
192.178.7.0/27
192.178.7.128/27
192.178.7.160/27
192.178.7.192/27
192.178.7.224/27
192.178.7.32/27
192.178.7.64/27
192.178.7.96/27
2001:4860:4801:10::/64
2001:4860:4801:11::/64
2001:4860:4801:12::/64
2001:4860:4801:13::/64
2001:4860:4801:14::/64
2001:4860:4801:15::/64
2001:4860:4801:16::/64
2001:4860:4801:17::/64
2001:4860:4801:18::/64
2001:4860:4801:19::/64
2001:4860:4801:1a::/64
2001:4860:4801:1b::/64
2001:4860:4801:1c::/64
2001:4860:4801:1d::/64
2001:4860:4801:1e::/64
2001:4860:4801:1f::/64
2001:4860:4801:20::/64
2001:4860:4801:21::/64
2001:4860:4801:22::/64
2001:4860:4801:23::/64
2001:4860:4801:24::/64
2001:4860:4801:25::/64
2001:4860:4801:26::/64
2001:4860:4801:27::/64
2001:4860:4801:28::/64
2001:4860:4801:29::/64
2001:4860:4801:2::/64
2001:4860:4801:2a::/64
2001:4860:4801:2b::/64
2001:4860:4801:2c::/64
2001:4860:4801:2d::/64
2001:4860:4801:2e::/64
2001:4860:4801:2f::/64
2001:4860:4801:30::/64
2001:4860:4801:31::/64
2001:4860:4801:32::/64
2001:4860:4801:33::/64
2001:4860:4801:34::/64
2001:4860:4801:35::/64
2001:4860:4801:36::/64
2001:4860:4801:37::/64
2001:4860:4801:38::/64
2001:4860:4801:39::/64
2001:4860:4801:3a::/64
2001:4860:4801:3b::/64
2001:4860:4801:3c::/64
2001:4860:4801:3d::/64
2001:4860:4801:3e::/64
2001:4860:4801:3f::/64
2001:4860:4801:40::/64
2001:4860:4801:41::/64
2001:4860:4801:42::/64
2001:4860:4801:44::/64
2001:4860:4801:45::/64
2001:4860:4801:46::/64
2001:4860:4801:47::/64
2001:4860:4801:48::/64
2001:4860:4801:49::/64
2001:4860:4801:4a::/64
2001:4860:4801:4b::/64
2001:4860:4801:4c::/64
2001:4860:4801:4d::/64
2001:4860:4801:4e::/64
2001:4860:4801:50::/64
2001:4860:4801:51::/64
2001:4860:4801:52::/64
2001:4860:4801:53::/64
2001:4860:4801:54::/64
2001:4860:4801:55::/64
2001:4860:4801:56::/64
2001:4860:4801:57::/64
2001:4860:4801:58::/64
2001:4860:4801:59::/64
2001:4860:4801:60::/64
2001:4860:4801:61::/64
2001:4860:4801:62::/64
2001:4860:4801:63::/64
2001:4860:4801:64::/64
2001:4860:4801:65::/64
2001:4860:4801:66::/64
2001:4860:4801:67::/64
2001:4860:4801:68::/64
2001:4860:4801:69::/64
2001:4860:4801:6a::/64
2001:4860:4801:6b::/64
2001:4860:4801:6c::/64
2001:4860:4801:6d::/64
2001:4860:4801:6e::/64
2001:4860:4801:6f::/64
2001:4860:4801:70::/64
2001:4860:4801:71::/64
2001:4860:4801:72::/64
2001:4860:4801:73::/64
2001:4860:4801:74::/64
2001:4860:4801:75::/64
2001:4860:4801:76::/64
2001:4860:4801:77::/64
2001:4860:4801:78::/64
2001:4860:4801:79::/64
2001:4860:4801:7a::/64
2001:4860:4801:7b::/64
2001:4860:4801:7c::/64
2001:4860:4801:7d::/64
2001:4860:4801:7e::/64
2001:4860:4801:7f::/64
2001:4860:4801:80::/64
2001:4860:4801:81::/64
2001:4860:4801:82::/64
2001:4860:4801:83::/64
2001:4860:4801:84::/64
2001:4860:4801:85::/64
2001:4860:4801:86::/64
2001:4860:4801:87::/64
2001:4860:4801:88::/64
2001:4860:4801:90::/64
2001:4860:4801:91::/64
2001:4860:4801:92::/64
2001:4860:4801:93::/64
2001:4860:4801:94::/64
2001:4860:4801:95::/64
2001:4860:4801:96::/64
2001:4860:4801:97::/64
2001:4860:4801:a0::/64
2001:4860:4801:a1::/64
2001:4860:4801:a2::/64
2001:4860:4801:a3::/64
2001:4860:4801:a4::/64
2001:4860:4801:a5::/64
2001:4860:4801:a6::/64
2001:4860:4801:a7::/64
2001:4860:4801:a8::/64
2001:4860:4801:a9::/64
2001:4860:4801:aa::/64
2001:4860:4801:ab::/64
2001:4860:4801:ac::/64
2001:4860:4801:ad::/64
2001:4860:4801:ae::/64
2001:4860:4801:b0::/64
2001:4860:4801:b1::/64
2001:4860:4801:b2::/64
2001:4860:4801:b3::/64
2001:4860:4801:b4::/64
2001:4860:4801:b5::/64
2001:4860:4801:b6::/64
2001:4860:4801:c::/64
2001:4860:4801:f::/64
34.100.182.96/28
34.101.50.144/28
34.118.254.0/28
34.118.66.0/28
34.126.178.96/28
34.146.150.144/28
34.147.110.144/28
34.151.74.144/28
34.152.50.64/28
34.154.114.144/28
34.155.98.32/28
34.165.18.176/28
34.175.160.64/28
34.176.130.16/28
34.22.85.0/27
34.64.82.64/28
34.65.242.112/28
34.80.50.80/28
34.88.194.0/28
34.89.10.80/28
34.89.198.80/28
34.96.162.48/28
35.247.243.240/28
66.249.64.0/27
66.249.64.128/27
66.249.64.160/27
66.249.64.192/27
66.249.64.224/27
66.249.64.32/27
66.249.64.64/27
66.249.64.96/27
66.249.65.0/27
66.249.65.128/27
66.249.65.160/27
66.249.65.192/27
66.249.65.224/27
66.249.65.32/27
66.249.65.64/27
66.249.65.96/27
66.249.66.0/27
66.249.66.128/27
66.249.66.160/27
66.249.66.192/27
66.249.66.224/27
66.249.66.32/27
66.249.66.64/27
66.249.66.96/27
66.249.67.0/27
66.249.67.32/27
66.249.67.64/27
66.249.68.0/27
66.249.68.128/27
66.249.68.160/27
66.249.68.192/27
66.249.68.32/27
66.249.68.64/27
66.249.68.96/27
66.249.69.0/27
66.249.69.128/27
66.249.69.160/27
66.249.69.192/27
66.249.69.224/27
66.249.69.32/27
66.249.69.64/27
66.249.69.96/27
66.249.70.0/27
66.249.70.128/27
66.249.70.160/27
66.249.70.192/27
66.249.70.224/27
66.249.70.32/27
66.249.70.64/27
66.249.70.96/27
66.249.71.0/27
66.249.71.128/27
66.249.71.160/27
66.249.71.192/27
66.249.71.224/27
66.249.71.32/27
66.249.71.64/27
66.249.71.96/27
66.249.72.0/27
66.249.72.128/27
66.249.72.160/27
66.249.72.192/27
66.249.72.224/27
66.249.72.32/27
66.249.72.64/27
66.249.72.96/27
66.249.73.0/27
66.249.73.128/27
66.249.73.160/27
66.249.73.192/27
66.249.73.224/27
66.249.73.32/27
66.249.73.64/27
66.249.73.96/27
66.249.74.0/27
66.249.74.128/27
66.249.74.160/27
66.249.74.192/27
66.249.74.224/27
66.249.74.32/27
66.249.74.64/27
66.249.74.96/27
66.249.75.0/27
66.249.75.128/27
66.249.75.160/27
66.249.75.192/27
66.249.75.224/27
66.249.75.32/27
66.249.75.64/27
66.249.75.96/27
66.249.76.0/27
66.249.76.128/27
66.249.76.160/27
66.249.76.192/27
66.249.76.224/27
66.249.76.32/27
66.249.76.64/27
66.249.76.96/27
66.249.77.0/27
66.249.77.128/27
66.249.77.160/27
66.249.77.192/27
66.249.77.224/27
66.249.77.32/27
66.249.77.64/27
66.249.77.96/27
66.249.78.0/27
66.249.78.128/27
66.249.78.160/27
66.249.78.192/27
66.249.78.224/27
66.249.78.32/27
66.249.78.64/27
66.249.78.96/27
66.249.79.0/27
66.249.79.128/27
66.249.79.160/27
66.249.79.192/27
66.249.79.224/27
66.249.79.32/27
66.249.79.64/27

// Verification

Verify authenticity

Start with the source IP recorded by your trusted edge or server, not an untrusted forwarded header.

Test one CIDR in Python (replace REQUEST_IP)
python3 -c 'import ipaddress; print(ipaddress.ip_address("REQUEST_IP") in ipaddress.ip_network("192.178.4.0/27"))'
Reverse- and forward-DNS double lookup
host REQUEST_IP
# Confirm the hostname ends in an official suffix
host RETURNED_HOSTNAME
# The forward lookup must return REQUEST_IP

For production checks, test against every current prefix in the vendor feed. Re-fetch feeds regularly: a July 2026 snapshot is evidence of publication, not a permanent firewall list.

// Robots.txt

Control it with robots.txt

Google documents crawler controls for this bot family. Robots.txt can direct cooperative crawling, but it cannot prove that a request is authentic.

Allow Googlebot
User-agent: Googlebot
Allow: /
Block Googlebot
User-agent: Googlebot
Disallow: /

Read Google's official crawler documentation ↗

// Analytics

Track it

Aiola tracks this crawler on your site — crawls, pages, trends. See when Googlebot arrives, which URLs it requests, and how activity changes over time.

// FAQ

FAQ

What is Googlebot?

Googlebot crawls and renders pages for Google Search indexing, including surfaces that supply search results to AI features. Aiola classifies it as indexing because it supports a searchable retrieval index.

What user-agent token identifies Googlebot?

Match the case-insensitive token “Googlebot” in the User-Agent header. A matching header alone does not authenticate the sender.

Can I verify Googlebot by IP address?

Google publishes a JSON feed, and this page snapshots 315 CIDR prefixes fetched on 2026-07-11. Match the source IP against the current vendor feed before trusting it.

Can robots.txt block Googlebot?

Google documents crawler controls for this bot family. Robots.txt can direct cooperative crawling, but it cannot prove that a request is authentic. Use the specific “Googlebot” group when you want a rule for this identity without changing rules for every crawler.

// Related

Related