AI Bot Activity

How AI assistants, AI search engines, crawlers and agents crawl the web over time

20 AI bots tracked

772 sites in cohort

Updated: July 2, 2026

Apr 2026 → Jun 2026

💡 Based on a fixed cohort of 772 sites with Ahrefs Bot Analytics enabled since Apr 2026 — a representative sample, not whole-web totals.

AI bots over time — by bot #

Top 20 individual AI bots (assistants, AI search, crawlers, agents).

💡 Click legend items to show/hide bots. “Share of bot traffic” = each bot’s requests ÷ total bot requests.

AI bot traffic over time — by industry #

Which industries AI bots crawl most (website industry from Ahrefs’ domain classifier).

💡 “Share of AI bot traffic” = each industry’s AI-bot requests ÷ total AI-bot requests (sums to 100%). “Unknown” = domains Ahrefs hasn’t classified.

AI crawler traffic by page type · Jun 2026 #

What kinds of pages AI crawlers fetch (Ahrefs ML page classifier).

💡 Click a type with › to drill into its subtypes. A page can match several types (each above a confidence threshold), so subtype shares may sum to more than 100% — but no subtype exceeds its parent.