Libraries tagged by magento 2 robots

Magento 2 AEO (AI Engine Optimization) Audit. v4 covers 18 signals across two layers: configuration checks (robots.txt with purpose-classified AI bots, llms.txt + llms.jsonl, Product / Organization / FAQ schema, merchant return + shipping policies, sitemap.xml, UCP profile, AI product feed, OG tags, canonical + hreflang, JSON-LD quality, well-known endpoint matrix, Core Web Vitals via CrUX) and an evidence layer (WAF-vs-robots.txt reality check, observed AI crawler activity via GDPR-safe built-in instrumentation or access-log source). Score Trend dashboard, Admin UI, configurable cron, CI-ready CLI, dependency-injected extension points for custom checkers and evidence sources.

Go to Download

This Magento 2 module provides the ability to add a noindex meta tag to category pages with filters

Go to Download

Add filterable attributes to robots.txt in Magento 2

Go to Download

Panth Advanced SEO — enterprise-grade SEO suite for Magento 2: SEO dashboard, meta templates, SEO rules engine, bulk meta editor, custom canonicals, filter URL rewrites, filter page meta, hreflang, product feeds, missing meta report, SEO audit & crawl results, structured data (JSON-LD), breadcrumbs, OpenGraph/Twitter social meta, llms.txt + llms-full.txt. Hyva and Luma compatible.

Go to Download

Complete SEO Robots solution for Magento 2 with flexible directive management, multiselect UI, and independent X-Robots-Tag configuration

Go to Download

Core implementation of SEO Robots module with flexible directive management and automatic migration

Go to Download

Panth Robots SEO — dedicated robots.txt, X-Robots-Tag, and LLM-bot (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.) policy control for Magento 2. Extracted from Panth_AdvancedSEO. Self-contained: emits a per-store robots.txt, adds X-Robots-Tag response headers, validates robots meta directives, and exposes admin CRUD for user-agent / path policies. Hyva and Luma compatible.

Go to Download

Magento 2 module for AI Engine Optimization (AEO). Manages AI crawler rules in robots.txt (OAI-SearchBot, GPTBot, ChatGPT-User, PerplexityBot, Google-Extended, ClaudeBot, Claude-SearchBot, Applebot-Extended, CCBot and more) without overwriting your existing configuration, emits IETF Content-Usage, Cloudflare Content-Signal and RSL License directives, and verifies that a crawler is genuine via Web Bot Auth request signatures (RFC 9421) or vendor-published IP ranges.

Go to Download

SEO module for Smile Custom Entity to add SEO attributes (meta title, meta description, meta keywords, meta robots).

Go to Download

Magento 2 Robots Meta Tag Extension

Go to Download

Magento 2 Robots Meta Tag Extension

Go to Download

Complete SEO Robots Category solution for Magento 2 with flexible directive management, multiselect UI, and independent X-Robots-Tag configuration

Go to Download

Complete SEO Robots Product package - includes API, Core, Admin UI, and Frontend modules for product-level robots meta tag and X-Robots-Tag header management

Go to Download

Frontend implementation for SEO Robots Product with independent X-Robots-Tag support and directive arrays

Go to Download

API interfaces for SEO Robots Product module with flexible directive management

Go to Download