Libraries tagged by robots.txt

X-Robots-Tag HTTP header parser class

Go to Download

Clean-Param URL filtering class - Find and remove any duplicate URL

Go to Download

Wordpress customiser tools for beginer and confirmed users.

Go to Download

Migration support, maintenance and security: Provides a backend module for showing which plugins / templates included where and some security related topics. Check configured sitemap.xml and robots.txt

Go to Download

Generator robots.txt

Go to Download

Generate sitemap.xml and robots.txt files in Laravel 4.2 with support for multi-language. Based on Hettiger/SeoAggregator

Go to Download

Generate custom robots.txt for subsites

Go to Download

Class to check a URL for robots exclusion using all possible methods of robots exclusion

Go to Download

Dynamic robots.txt files for Laravel projects

Go to Download

Non Production Robots Ignore is a simple WordPress plugin that is used with vlucas/phpdotenv (or similar) that sets environment variables to set robots.txt to ignore all on all environments except production.

Go to Download

A small package for parsing websites' robots.txt files

Go to Download

A route for serving a basic robots.txt in Laravel 5.1+, based on configuration settings.

Go to Download

A PHP 5.3+ framework for Robots.txt

Go to Download

Laravel robots.txt manager

Go to Download

Increase and control index-ability of your site; PHP library for generating sitemaps and controlling all the robots.

Go to Download