Known Agents helps you see and control the AI bots and crawlers visiting your website.
Track real-time bot and AI agent traffic across every page of your website
Automatically update your robots.txt to block new scrapers as they emerge
Detect spoofed bots pretending to be legitimate crawlers like Googlebot
Measure LLM referral traffic from ChatGPT, Claude, Gemini, and other AI chat platforms
Replay individual AI agent sessions to see where they get stuck
Use the Agent Identification API to authenticate bots inside your own products
Source: knownagents.com·Verified June 2026
No integrations listed yet for Known Agents.
Known Agents uses AI agent identification and classification to detect, verify, and categorize bots — including catching AI scrapers that spoof legitimate crawlers.
Known Agents is a strong fit for content publishers, SaaS companies with documentation sites, or ecommerce stores that want to understand how AI bots interact with their web presence. The automatic robots.txt feature alone can save you hours of manual upkeep, and the LLM citation tracking is genuinely useful if you care about showing up in AI search results. That said, pricing isn't transparent upfront, and if your site gets low traffic, you may not have enough bot data to make the analytics meaningful.
AI-generated training guides tailored to your team's size, skill level, and focus areas for Known Agents — coming in v0.3.2.
View our roadmap →We're building a review system so business owners like you can share real experiences with Known Agents.
Real workflows that use Known Agents to save time.
Guarantee every scraper gets a response ticket within 2 minutes of detection and cut manual ticket creation to zero.
Save 1.5 hours/week on reporting and give your team a 12-week bot traffic history they can act on.
Respond to new AI crawlers within 5 minutes instead of days and save 2 hours/week on manual log reviews.
Build a complete bot-blocking audit log automatically, saving 1 hour/week of manual documentation.
Last researched: June 2026
