Firecrawl · Other
FirecrawlAgent
FirecrawlAgent is the robots.txt token for a customer-directed crawler; the fetch User-Agent is not guaranteed to carry it. No fixed IP range is published.
Key facts
FirecrawlAgentWhat FirecrawlAgent is
FirecrawlAgent is the robots.txt token for a customer-directed crawler; the fetch User-Agent is not guaranteed to carry it. No fixed IP range is published.
In Aiola's taxonomy, Other means advertising, link previews, content-use controls and other automation.
FirecrawlAgent user agent
FirecrawlAgent is a robots.txt token; the fetch User-Agent is not guaranteed to contain it.
FirecrawlAgentFirecrawlAgentOfficial IP ranges
Firecrawl has not published official IP ranges that Aiola successfully fetched for FirecrawlAgent. Aiola does not list cloud-provider ranges or community guesses as if they authenticated this crawler.
Verify a FirecrawlAgent request
No IP authentication method is documented in this record for FirecrawlAgent. Its user-agent token is a claim, not proof of identity.
Use the exact header token for classification and apply your own access controls. Check the vendor documentation for any newly published IP, token or header verification method.
Control FirecrawlAgent with robots.txt
Firecrawl documents crawler controls for this bot family. Robots.txt can direct cooperative crawling, but it cannot prove that a request is authentic.
User-agent: FirecrawlAgent
Allow: /User-agent: FirecrawlAgent
Disallow: /Aiola Analytics
See every FirecrawlAgent visit on your site
Aiola tracks 80 AI, search and link-preview crawlers next to your human traffic, revenue and errors. See when FirecrawlAgent arrives, which pages it requests and which requests fail. Then ask a coding agent in the same app to fix those pages. Track FirecrawlAgent visits with AI crawler analytics.
Common questions
Everything your agents need, in one app
Errors, user feedback, GitHub and analytics live next to your coding agents. Every issue becomes a task an agent can take.