Libraries tagged by robots
cuab/phpcrawl
41881 Downloads
PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.
innoweb/silverstripe-robots
19032 Downloads
Adds a Robots.txt file that is configurable from /admin/settings/.
fuelviews/laravel-robots-txt
8171 Downloads
Laravel robots txt package
fkrzski/robots-txt
3094 Downloads
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
devgeniem/wp-noindex-testing-staging-robots
19059 Downloads
Uses robots.txt to not index development/testing environments of this site with search-engines
calchen/laravel-dingtalk-robot-notification
26772 Downloads
钉钉智能群助手 Laravel/Lumen 消息通知扩展包（Dingtalk robot message notifications for Laravel/Lumen）
taurus-media/module-robots
844 Downloads
Add filterable attributes to robots.txt in Magento 2
ritaswc/dingtalk-robot
9810 Downloads
Easy to send dingtalk robot message
pluswerk/uptime-robot
18962 Downloads
Simple wrapper to call uptime-robot heartbeat unified
merkandi/laravel-5-robots
41787 Downloads
Robots.txt Generator for Laravel 5
mage-os/meta-robots-tag
973 Downloads
NoIndex NoFollow NoArchive Tag extension
execut/yii2-robots-txt
13885 Downloads
Module for generate robots.txt file by url rules
eliashaeussler/typo3-sitemap-robots
13333 Downloads
Extension for TYPO3 CMS to enhance robots.txt with sitemap configurations
creativestyle/magesuite-seo-meta-robots
17570 Downloads
Extension allows control over robots meta tag
wizardcompass/robots-txt-parser
3294 Downloads
DEPRECATED — use leopoletto/robots-txt-parser. Compatibility shim that delegates to it.