Libraries tagged by robo
consolidation/robo
55044762 Downloads
Modern task runner
nette/robot-loader
47134027 Downloads
🍀 Nette RobotLoader: high performance and comfortable autoloader that will search and autoload classes within your application.
spatie/robots-txt
12559628 Downloads
Determine if a page may be crawled from robots.txt and robots meta tags
consolidation/filter-via-dot-access-data
40104110 Downloads
This project uses dflydev/dot-access-data to provide simple output filtering for applications built with annotated-command / Robo.
spatie/laravel-robots-middleware
1808853 Downloads
Add an `all` or `none` robots header to your requests via a middleware in Laravel
codegyre/robo
997021 Downloads
Modern task runner
webignition/robots-txt-file
1109945 Downloads
Models a robots.txt file
verschuur/laravel-robotstxt
338664 Downloads
Set the robots.txt content dynamically based on the Laravel app environment.
codeception/robo-paracept
3356505 Downloads
Codeception Parallel Execution Tasks via Robo Task Runner
vipnytt/sitemapparser
1804390 Downloads
XML Sitemap parser class compliant with the Sitemaps.org protocol.
monperrus/crawler-user-agents
2309 Downloads
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
vipnytt/robotstxtparser
693423 Downloads
Robots.txt parsing library, with full support for every directive and specification.
t1gor/robots-txt-parser
482462 Downloads
PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.
spryker/robotframework-suite-tests
75105 Downloads
Automated tests for the Robot Framework
healey/robots
194466 Downloads
Robots.txt Generator for Laravel 4 and 5