Libraries tagged by robo

consolidation/robo

2716 Favers
73780148 Downloads

Modern task runner

Go to Download


spatie/robots-txt

263 Favers
23628683 Downloads

Determine if a page may be crawled from robots.txt and robots meta tags

Go to Download


nette/robot-loader

894 Favers
60059631 Downloads

🍀 Nette RobotLoader: autoloads every class, interface, trait and enum in your directories, with no PSR-4 and no naming rules, and remembers where it found them.

Go to Download


consolidation/filter-via-dot-access-data

45 Favers
56305302 Downloads

This project uses dflydev/dot-access-data to provide simple output filtering for applications built with annotated-command / Robo.

Go to Download


spatie/laravel-robots-middleware

337 Favers
2533957 Downloads

Add an `all` or `none` robots header to your requests via a middleware in Laravel

Go to Download


vipnytt/sitemapparser

82 Favers
2630053 Downloads

XML Sitemap parser class compliant with the Sitemaps.org protocol.

Go to Download


codegyre/robo

2708 Favers
1019330 Downloads

Modern task runner

Go to Download


webignition/robots-txt-file

19 Favers
1607351 Downloads

Models a robots.txt file

Go to Download


verschuur/laravel-robotstxt

43 Favers
496035 Downloads

Set the robots.txt content dynamically based on the Laravel app environment.

Go to Download


codeception/robo-paracept

58 Favers
3821532 Downloads

Codeception Parallel Execution Tasks via Robo Task Runner

Go to Download


bopoda/robots-txt-parser

48 Favers
341465 Downloads

PHP Class for parsing robots.txt files according to Google, Yandex specifications.

Go to Download


monperrus/crawler-user-agents

1414 Favers
7909 Downloads

This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.

Go to Download


yii-cms/yii2-robokassa

41 Favers
70018 Downloads

Robokassa payment extension.

Go to Download


vipnytt/robotstxtparser

25 Favers
851601 Downloads

Robots.txt parsing library, with full support for every directive and specification.

Go to Download


tractorcow/silverstripe-robots

14 Favers
106888 Downloads

Simple robots generation module for Silverstripe

Go to Download


Next >>