Etiqueta del plugin: crawler
-
AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control
Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.
-
-
Virtual LLMS.TXT Generator
Safely creates a virtual llms.txt dynamically. Features interactive bot targeting, map auto-syncing, and decoupled custom instructions.
-
URLs Most Wanted for LiteSpeed LScache
A demand-driven sitemap for LiteSpeed Cache warmup. Record the URLs visitors actually use and warm only what people need.
-
Pixellize Site Issue Scanner
Powerful SEO auditor by Pixellize. Crawls your site to fix broken links, missing meta tags, and unoptimized images.
-
Whizz MD — Markdown Endpoints for AI Crawlers
Serve every WordPress post and page as a clean .md file with full SEO frontmatter — discoverable by AI crawlers and search engines on the fly.
-
FocusWeb AI Crawler Monitor – Track, Verify & Block AI Bots
Track, verify and block AI crawlers (GPTBot, ClaudeBot, PerplexityBot). Spot spoofed bots, control robots.txt, measure AI referral traffic.
-
WEO LLMS & AI Crawler Guide
The professional architect for your llms.txt file. Control how AI agents (ChatGPT, Claude, Perplexity) consume your website content with a structured, …
-
Cleotic AI Traffic
See AI crawler visits and AI assistant referrals on your site, with optional signed sync to Cleotic.
-
Trimardeau SEO Log
Google crawls you. AIs read you. See everything: search engine and AI crawler analytics for every post, page and term.
-
OpenBotAuth – AI Crawler Access Control
Verify AI crawlers with HTTP Signatures and enforce allow/deny/teaser policies; also serves llms.txt and AI-ready feeds.
-
Bottoll – AI Crawler Control
Detect AI crawlers, apply access policies, and understand automated access to your WordPress content.
-
OtterFixer AI Bot Tracker
A lightweight plugin that logs visits from common AI/LLM crawler user-agents and shows a simple report in wp-admin.
