What your server log already knows
Every request to your site is written to an access log: the address, the page, the time, the status and the user agent. Hidden in it is a full history of which AI and search crawlers visited, what they read, and where they hit errors.
The Log Analyzer reads that file for you and turns it into a short report.
- Visits per crawler: OpenAI, Anthropic, Perplexity, Google, Bing, Apple, Meta and others
- Real vs fake: each visit checked against the official IP lists
- Pages crawlers read most, and errors they ran into
- Hours and days of activity
- Pages you block by mistake
Which log formats work
The standard "combined" format used by nginx, Apache, LiteSpeed and most hosts. Upload the plain file or the .gz version, up to 50 MB. One to seven days of log is usually enough.
Your file stays private
The file is read once to build your report and then deleted. If you choose to, only anonymous totals are added to the public AI Crawler Radar.
Key terms
- Access log
- The file your web server writes with one line per request.
- Fake bot
- A visitor that claims to be a known crawler but comes from an address the crawler's owner does not use.