Libraries tagged by 64Robots

Show a warning in the CMS when site is set to noindex

Go to Download

Middleware to enable/disable the robots of the search engines

Go to Download

This Magento 2 module provides the ability to add a noindex meta tag to category pages with filters

Go to Download

Robots.txt generator service.

Go to Download

The RobotsTxtBundle adds the ability to generate robots.txt file to your application.

Go to Download

A library to build robots.txt

Go to Download

A simple robots.txt generator.

Go to Download

Parser for robots.txt files

Go to Download

Set the robots.txt content dynamically based on the Laravel app environment.

Go to Download

Headless manager for the well-known files every modern web app owes bots AND agents — robots.txt, .well-known/security.txt, llms.txt, humans.txt, sitemap.xml, and an agents/AI manifest. Define them once in code/config and serve them consistently. Zero runtime deps; ships a default-open robots evaluator so scrapers can honor robots honestly, and makes it hard to leak a protected path. Framework-agnostic core + Laravel adapter.

Go to Download

Server-rendered SEO + crawlability for Laravel + Inertia apps — per-route meta/Open Graph/Twitter/JSON-LD on the first byte, dynamic sitemap.xml / robots.txt / llms.txt, and per-page Markdown. The PHP baseline that pairs with @particle-academy/fancy-inertia's .

Go to Download

Symfony bundle for SEO management: meta tags (OpenGraph, Twitter Cards), Schema.org JSON-LD structured data, sitemap XML generation, and robots.txt

Go to Download

Laravel middleware za blokiranje AI crawlera i tražilica. Auto-registracija, konfigurabilan, podržava Laravel 10/11/12/13.

Go to Download

SEO management plugin for Filament v5 - meta tags, global settings, Schema.org, robots.txt

Go to Download

Shared, framework-agnostic building blocks for polite and safe web crawlers: SSRF-aware HTTP throttling, robots.txt parsing, and HTML link discovery.

Go to Download