Libraries tagged by robo
consolidation/robo
73780148 Downloads
Modern task runner
spatie/robots-txt
23628683 Downloads
Determine if a page may be crawled from robots.txt and robots meta tags
nette/robot-loader
60059631 Downloads
🍀 Nette RobotLoader: autoloads every class, interface, trait and enum in your directories, with no PSR-4 and no naming rules, and remembers where it found them.
consolidation/filter-via-dot-access-data
56305302 Downloads
This project uses dflydev/dot-access-data to provide simple output filtering for applications built with annotated-command / Robo.
spatie/laravel-robots-middleware
2533957 Downloads
Add an `all` or `none` robots header to your requests via a middleware in Laravel
vipnytt/sitemapparser
2630053 Downloads
XML Sitemap parser class compliant with the Sitemaps.org protocol.
codegyre/robo
1019330 Downloads
Modern task runner
webignition/robots-txt-file
1607351 Downloads
Models a robots.txt file
verschuur/laravel-robotstxt
496035 Downloads
Set the robots.txt content dynamically based on the Laravel app environment.
codeception/robo-paracept
3821532 Downloads
Codeception Parallel Execution Tasks via Robo Task Runner
bopoda/robots-txt-parser
341465 Downloads
PHP Class for parsing robots.txt files according to Google, Yandex specifications.
monperrus/crawler-user-agents
7909 Downloads
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
yii-cms/yii2-robokassa
70018 Downloads
Robokassa payment extension.
vipnytt/robotstxtparser
851601 Downloads
Robots.txt parsing library, with full support for every directive and specification.
tractorcow/silverstripe-robots
106888 Downloads
Simple robots generation module for Silverstripe