Libraries tagged by 64Robots

A professional, production-ready PHP XML sitemap generator with advanced features: concurrency, robots.txt, caching, database storage, change detection, SEO analysis, JavaScript rendering, proxy support, webhooks, and more.

Go to Download

A package containing SEO helpers.

Go to Download

Opinionated SEO plugin for Kirby 4. With meta description, open graph, sitemap and robots.txt

Go to Download

PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

Go to Download

Kirby robots.txt plugin for blocking AI Crawlers and Bots

Go to Download

多站点复用的通用后台底座：广告、站点设置、ads.txt、robots.txt、后台中文、登录与默认管理员（Laravel 12 + Filament 5）。

Go to Download

This module blocks (well-behaved) search engine robots from crawling, indexing, or archiving your site by setting a "X-Robots-Tag: noindex,nofollow,noarchive" HTTP header.

Go to Download

A Laravel Nova tool fork.

Go to Download

Laravel Dynamic Robots Package

Go to Download

Go to Download

Lightweight, framework-agnostic robots.txt management for PHP

Go to Download

This is Pico's official robots plugin to add a robots.txt and sitemap.xml to your website. Pico is a stupidly simple, blazing fast, flat file CMS.

Go to Download

PSR-15 middleware to avoid search engine indexing with PSR-7

Go to Download

Laravel 5.x helpers for a semi-automated robots.txt and meta tags

Go to Download

Class to check a URL for robots exclusion using all possible methods of robots exclusion

Go to Download