Libraries tagged by robotstxt
monsieurbiz/mbiz_robotstxt
152 Downloads
Magento extension to edit robots.txt from the admin panel.
innmind/robots-txt
422 Downloads
Robots.txt parser
hugsbrugs/php-robots-txt
35 Downloads
PHP Robots.txt Utilities
boomcms/boom-robotstxt
860 Downloads
robots.txt generator for BoomCMS
codeinc/robots-txt-middleware
29 Downloads
A PSR-15 middleware to answers /robots.txt requests
bisarca/robots-txt
54 Downloads
Robots.txt Component
wdmg/yii2-robots
412 Downloads
Module for automatically generating and edit the robots.txt file
vipnytt/robotstagparser
368 Downloads
X-Robots-Tag HTTP header parser class
vipnytt/cleanparam-url-filter
74 Downloads
Clean-Param URL filtering class - Find and remove any duplicate URL
thanatos-vf-2000/ct4gg
3 Downloads
Wordpress customiser tools for beginer and confirmed users.
taketool/sysinfo
407 Downloads
Migration support, maintenance and security: Provides a backend module for showing which plugins / templates included where and some security related topics. Check configured sitemap.xml and robots.txt
steein/robots
6329 Downloads
Generator robots.txt
samkitano/seo-gen
12 Downloads
Generate sitemap.xml and robots.txt files in Laravel 4.2 with support for multi-language. Based on Hettiger/SeoAggregator
oihana/php-robots
9 Downloads
The Oihana PHP Robots library
nickmoline/robots-checker
865 Downloads
Class to check a URL for robots exclusion using all possible methods of robots exclusion