Libraries tagged by robots

Panth Advanced SEO — enterprise-grade SEO suite for Magento 2: SEO dashboard, meta templates, SEO rules engine, bulk meta editor, custom canonicals, filter URL rewrites, filter page meta, hreflang, product feeds, missing meta report, SEO audit & crawl results, structured data (JSON-LD), breadcrumbs, OpenGraph/Twitter social meta, llms.txt + llms-full.txt. Hyva and Luma compatible.

Go to Download

Pre-flight check for indexnowkit: a GET of every URL before it is submitted to IndexNow — noindex, robots.txt, canonical, redirects and origin errors are skipped; check --sample

Go to Download

Botly is a Filament plugin to manage your site's robots.txt file directly from a Filament admin panel.

Go to Download

Laravel integration for BearyChat.

Go to Download

An elegant way of interacting with BearyChat webhooks.

Go to Download

The core of Robot Council, a coordination service for fleets of AI coding agents

Go to Download

A professional, production-ready PHP XML sitemap generator with advanced features: concurrency, robots.txt, caching, database storage, change detection, SEO analysis, JavaScript rendering, proxy support, webhooks, and more.

Go to Download

Kirby Plugin for a best-practice HTML Head Element extendable with snippets.

Go to Download

Professional SEO/AI indexing + Sitemap (index) + RSS + News/Image/Video sitemaps for CodeIgniter 4

Go to Download

Magento 2 AEO (AI Engine Optimization) Audit. v4 covers 18 signals across two layers: configuration checks (robots.txt with purpose-classified AI bots, llms.txt + llms.jsonl, Product / Organization / FAQ schema, merchant return + shipping policies, sitemap.xml, UCP profile, AI product feed, OG tags, canonical + hreflang, JSON-LD quality, well-known endpoint matrix, Core Web Vitals via CrUX) and an evidence layer (WAF-vs-robots.txt reality check, observed AI crawler activity via GDPR-safe built-in instrumentation or access-log source). Score Trend dashboard, Admin UI, configurable cron, CI-ready CLI, dependency-injected extension points for custom checkers and evidence sources.

Go to Download

Shared, framework-agnostic building blocks for polite and safe web crawlers: SSRF-aware HTTP throttling, robots.txt parsing, and HTML link discovery.

Go to Download

SEO building blocks for Waaseyaa (sitemap, robots.txt, meta tags, JSON-LD, Twig helpers)

Go to Download

A Laravel package from Trustip.io for VPN and Proxy detection, it allows you to check if an IP address is a Proxy, VPN, TOR, Hosting, Bad search engine robots or not.

Go to Download

Kirby robots.txt plugin for blocking AI Crawlers and Bots

Go to Download

Adds custom robots.txt rules for Web Services websites

Go to Download