Libraries tagged by ai crawlers

Instant indexing and GEO for Craft CMS — push URLs to Google's Indexing API and IndexNow the moment they change, then manage, log and audit how AI search engines read your site.

Go to Download

Generative Engine Optimization (GEO) for Laravel: llms.txt, JSON-LD structured data, and AI crawler tooling.

Go to Download

Spyglasses AI Traffic Analytics for Drupal - Detect, block and log your website's AI traffic using Drupal's middleware API.

Go to Download

MNB ScraperKit V1.0.3 - enterprise-ready PHP crawling and data extraction framework with AI crawl intelligence, search discovery, authorized mail/webmail extraction connectors, publisher metadata workflows, extraction recipes, provenance, quality reports, datasets, queues, dashboards, and compliance tooling.

Go to Download

LLMO (Large Language Model Optimization) for Magento 2. ACP-style product feed, schema validation, AI crawler controls, AI-ready content fields, attribution and conversion tracking, campaign abstraction for AI ads, and an LLMO visibility dashboard.

Go to Download

SEO and GEO for Craft 5 — meta, schema, redirects, llms.txt, AI crawler controls. API-first, with PHPBench-enforced performance budgets.

Go to Download

A lightweight package that blocks unwanted crawlers, AI agents, scrapers, and high‑frequency visitors while allowing legitimate bots such as Googlebot and Bingbot to pass.

Go to Download