AI Crawl Control - Enhanced crawler insights and custom 402 responses
We improved AI crawler management with detailed analytics and introduced custom HTTP 402 responses for blocked crawlers. AI Audit has been renamed to AI Crawl Control and is now generally available. Enhanced Crawlers tab: View total allowed and blocked requests for each AI crawler Trend charts show crawler activity over your selected time range per crawler Custom block responses (paid plans): You can now return HTTP 402 "Payment Required" responses when blocking AI crawlers, enabling direct com
