Libraries tagged by robots-txt

A PSR-15 middleware to answers /robots.txt requests

Go to Download

Robots.txt Component

Go to Download

X-Robots-Tag HTTP header parser class

Go to Download

Clean-Param URL filtering class - Find and remove any duplicate URL

Go to Download

Wordpress customiser tools for beginer and confirmed users.

Go to Download

Migration support, maintenance and security: Provides a backend module for showing which plugins / templates included where and some security related topics. Check configured sitemap.xml and robots.txt

Go to Download

Generator robots.txt

Go to Download

Generate sitemap.xml and robots.txt files in Laravel 4.2 with support for multi-language. Based on Hettiger/SeoAggregator

Go to Download

Generate custom robots.txt for subsites

Go to Download

Dynamic robots.txt files for Laravel projects

Go to Download

Non Production Robots Ignore is a simple WordPress plugin that is used with vlucas/phpdotenv (or similar) that sets environment variables to set robots.txt to ignore all on all environments except production.

Go to Download

A small package for parsing websites' robots.txt files

Go to Download

A route for serving a basic robots.txt in Laravel 5.1+, based on configuration settings.

Go to Download

A PHP 5.3+ framework for Robots.txt

Go to Download

Laravel robots.txt manager

Go to Download