Libraries tagged by robots.txt
cuab/phpcrawl
36006 Downloads
PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.
fkrzski/robots-txt
788 Downloads
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
execut/yii2-robots-txt
12343 Downloads
Module for generate robots.txt file by url rules
evheniy/robots-txt-bundle
19128 Downloads
The RobotsTxtBundle adds the ability to generate robots.txt file to your application.
monsieurbiz/sylius-robots-txt-plugin
4779 Downloads
Manage your robot.txt from your Sylius admin pannel
merkandi/laravel-5-robots
15921 Downloads
Robots.txt Generator for Laravel 5
eliashaeussler/typo3-sitemap-robots
5083 Downloads
Extension for TYPO3 CMS to enhance robots.txt with sitemap configurations
gverschuur/laravel-robotstxt
51 Downloads
Set the robots.txt content dynamically based on the Laravel app environment.
fuelviews/laravel-robots-txt
729 Downloads
Laravel robots txt package
becklyn/robots-txt
8097 Downloads
A library to build robots.txt
pixeo/laravel-robots
3085 Downloads
Set the robots.txt content dynamically based on the Laravel app environment.
jazzman/php-robots
145 Downloads
Generator robots.txt
innoweb/silverstripe-robots
12512 Downloads
Adds a Robots.txt file that is configurable from /admin/settings/.
bnomei/kirby3-htmlhead
3496 Downloads
Kirby Plugin for a best-practice HTML Head Element extendable with snippets.
svc/sitemap-bundle
113 Downloads
Bundle to create easy XML sitemaps and robots.txt files