Libraries tagged by X-Robots

User-Agent parser for robot rule sets

Go to Download

This module blocks (well-behaved) search engine robots from crawling, indexing, or archiving your site by setting a "X-Robots-Tag: noindex,nofollow,noarchive" HTTP header.

Go to Download

Class to check a URL for robots exclusion using all possible methods of robots exclusion

Go to Download

Panth Robots SEO — dedicated robots.txt, X-Robots-Tag, and LLM-bot (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.) policy control for Magento 2. Extracted from Panth_AdvancedSEO. Self-contained: emits a per-store robots.txt, adds X-Robots-Tag response headers, validates robots meta directives, and exposes admin CRUD for user-agent / path policies. Hyva and Luma compatible.

Go to Download

Symfony2 bundle to control X-Robots-Tag HTTP header via annotations

Go to Download

Complete SEO Robots solution for Magento 2 with flexible directive management, multiselect UI, and independent X-Robots-Tag configuration

Go to Download

Easily control X-Robots-Tag HTTP Headers

Go to Download

X-Robots-Tag HTTP header parser class

Go to Download

A comprehensive PHP package for parsing robots.txt files, including support for meta tags and X-Robots-Tag HTTP headers

Go to Download

Complete SEO Robots Product package - includes API, Core, Admin UI, and Frontend modules for product-level robots meta tag and X-Robots-Tag header management

Go to Download

Frontend implementation for SEO Robots Product with independent X-Robots-Tag support and directive arrays

Go to Download

Frontend implementation for SEO Robots with independent X-Robots-Tag support and directive arrays

Go to Download

Complete SEO Robots Category solution for Magento 2 with flexible directive management, multiselect UI, and independent X-Robots-Tag configuration

Go to Download

Frontend implementation for SEO Robots Category with independent X-Robots-Tag support and directive arrays

Go to Download