Libraries tagged by Robots meta tag

Determine if a page may be crawled from robots.txt and robots meta tags

Go to Download

Changes the robots meta tag to 'NOINDEX,NOFOLLOW' for some sensible pages like login

Go to Download

Control and limit catalog page indexing by altering the robots meta tag value based on applied filters in layered navigation.

Go to Download

Complete SEO Robots Product package - includes API, Core, Admin UI, and Frontend modules for product-level robots meta tag and X-Robots-Tag header management

Go to Download

Magento 2 Robots Meta Tag Extension

Go to Download

Magento 2 Robots Meta Tag Extension

Go to Download

Centrally manages robots.txt, the robots head meta tag and XML sitemap inclusion for any TYPO3 site (single-site or multisite), with environment-aware safety logic that guards production against accidental crawl-blocking while keeping staging/dev fully disallowed.

Go to Download

A comprehensive PHP package for parsing robots.txt files, including support for meta tags and X-Robots-Tag HTTP headers

Go to Download

Panth Robots SEO — dedicated robots.txt, X-Robots-Tag, and LLM-bot (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.) policy control for Magento 2. Extracted from Panth_AdvancedSEO. Self-contained: emits a per-store robots.txt, adds X-Robots-Tag response headers, validates robots meta directives, and exposes admin CRUD for user-agent / path policies. Hyva and Luma compatible.

Go to Download

stanford_metatag_nobots for blocking robots

Go to Download

Symfony2 bundle to control X-Robots-Tag HTTP header via annotations

Go to Download

X-Robots-Tag HTTP header parser class

Go to Download

Custom metatag Robots by pages, categories and products for Magento 2

Go to Download

Professional Laravel SEO Package - Complete SEO solution for Laravel applications

Go to Download

Enterprise-grade SEO Tools for CodeIgniter 4 — meta tags, Open Graph, Twitter Cards, JSON-LD schema types, sitemaps, robots.txt, hreflang, AI-bot governance and more.

Go to Download