Libraries tagged by meta robots

A package containing SEO helpers.

Go to Download

Opinionated SEO plugin for Kirby CMS. With meta description, open graph, sitemap and robots.txt

Go to Download

Class to check a URL for robots exclusion using all possible methods of robots exclusion

Go to Download

Panth Robots SEO — dedicated robots.txt, X-Robots-Tag, and LLM-bot (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.) policy control for Magento 2. Extracted from Panth_AdvancedSEO. Self-contained: emits a per-store robots.txt, adds X-Robots-Tag response headers, validates robots meta directives, and exposes admin CRUD for user-agent / path policies. Hyva and Luma compatible.

Go to Download

Centrally manages robots.txt, the robots head meta tag and XML sitemap inclusion for any TYPO3 site (single-site or multisite), with environment-aware safety logic that guards production against accidental crawl-blocking while keeping staging/dev fully disallowed.

Go to Download

Magento 2 module for AI Engine Optimization (AEO). Injects AI crawler rules (OAI-SearchBot, GPTBot, ChatGPT-User, PerplexityBot, Perplexity-User, Google-Extended, ClaudeBot, anthropic-ai, Claude-User, Applebot, cohere-ai, Amazonbot, Meta-ExternalAgent) into robots.txt — without overwriting your existing configuration. Supports per-bot Allow/Disallow lists, Crawl-delay, Sitemap directives, multi-store, and a public Api\RobotsStatusInterface for cross-module integration with angeo/module-aeo-audit.

Go to Download

Laravel 5.x helpers for a semi-automated robots.txt and meta tags

Go to Download

A comprehensive PHP package for parsing robots.txt files, including support for meta tags and X-Robots-Tag HTTP headers

Go to Download

Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang, meta robots, robots.txt, redirects, sitemap validation, HTML validation, performance...

Go to Download

A package containing SEO helpers.

Go to Download

An inclusive plugin to handle certain types of meta data through the siteconfig, as well as better and expanded handling of meta data in general

Go to Download

Seoquent - A powerful all-in-one Laravel SEO package. Meta tags, Open Graph, Twitter Cards, JSON-LD structured data, sitemap generation, robots.txt, and per-model SEO management.

Go to Download

SEO module for Smile Custom Entity to add SEO attributes (meta title, meta description, meta keywords, meta robots).

Go to Download

Extension allows control over robots meta tag

Go to Download

Determine if a page may be crawled from robots.txt and robots meta tags

Go to Download