ByteDance · Indexing

Bytespider

Identify Bytespider by its user agent. Check request identity, review robots.txt controls and track visits in Aiola Analytics.

Download AiolaAI crawler directory

Key facts

User-agent token: Bytespider
Indexing: Crawled for AI or search indexing.
ByteDance publishes official IP ranges; verify requests against them.

What Bytespider is

Bytespider crawls for Toutiao Search. ByteDance publishes User-Agent examples, ten IPv4 /24 blocks, and reverse-DNS verification under bytedance.com.

In Aiola's taxonomy, Indexing means crawled for ai or search indexing.

Bytespider user agent

Look for the match token inside the complete HTTP User-Agent header. Tokens can be spoofed, so use the network checks below for authentication.

Full example User-Agent
Mozilla/5.0 (compatible; Bytespider; https://zhanzhang.toutiao.com/) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.0.0 Safari/537.36
Case-insensitive match token
Bytespider

Official IP ranges

ByteDance publishes an official IP range list. This cached snapshot contains 10 CIDR prefixes, last fetched 2026-10-23. Open the live source ↗

Bytespider CIDRs — snapshot fetched 2026-10-23
110.249.201.0/24
110.249.202.0/24
111.225.148.0/24
111.225.149.0/24
220.243.135.0/24
220.243.136.0/24
220.243.188.0/24
220.243.189.0/24
60.8.123.0/24
60.8.151.0/24

Verify a Bytespider request

For Bytespider, compare the source IP from your trusted edge or server against ByteDance’s current published prefixes.

Test one CIDR in Python (replace REQUEST_IP)
python3 -c 'import ipaddress; print(ipaddress.ip_address("REQUEST_IP") in ipaddress.ip_network("110.249.201.0/24"))'

Test every current prefix in the vendor feed and re-fetch it regularly. This cached snapshot is evidence of publication, not a permanent firewall list.

Control Bytespider with robots.txt

ByteDance documents crawler controls for this bot family. Robots.txt can direct cooperative crawling, but it cannot prove that a request is authentic.

Allow Bytespider
User-agent: Bytespider
Allow: /
Block Bytespider
User-agent: Bytespider
Disallow: /

Read ByteDance's official crawler documentation ↗

Aiola Analytics

See every Bytespider visit on your site

Aiola tracks 70 AI, search and link-preview crawlers next to your human traffic. See when Bytespider arrives, which pages it requests and how that changes over time. Hosted Analytics needs Pro or a trial.

Download AiolaSet up bot tracking
Aiola Analytics showing AI crawler visits by bot and page

Common questions

Build, ship and fix in one app

Errors, user feedback, GitHub and analytics live next to your coding agents in one desktop app, so every issue becomes a task an agent can take.

Download Aiola