Advanced
AI Crawler Blocklist
Fix blocked requests with AI Crawler Blocklist diagnostics
Use the diagnostic tool, allow rules and snapshots to check why a request was matched and correct the policy.
Updated 1 min read By the D.C Style team
On this page
Test an IP and user agent
- The diagnostic tool works offline and sends no request.
- It shows decision, reason, evidence and snapshot reference.
Add an allow rule
- Add an IP or CIDR allow rule.
- Explicit allow rules take priority.
- Rules are owned by the add-on and do not change XenForo's global IP bans.
Understand search-crawler protection
- Google and Bing are protected via crawler feeds and cached forward-confirmed reverse DNS.
- A Googlebot or Bingbot user agent alone gives no exemption.
Check source health
- Last validated ranges are kept after errors.
- Stale automatic rules monitor instead of blocking.
- Large source changes are held for administrator review.
- Manual refresh requests are available.
Restore a previous policy
- Restore the previous policy snapshot if a change caused problems.