Libraries tagged by robo
bopoda/robots-txt-parser
167291 Downloads
PHP Class for parsing robots.txt files according to Google, Yandex specifications.
openeuropa/task-runner
177973 Downloads
PHP task runner based on Robo, focused on extensibility.
novactive/ezseobundle
220451 Downloads
Novactive eZ SEO Bundle is an Ibexa Platform bundle for SEO simplications. metas, sitemaps, robots.txt, etc.
wangju/ding-notice
166129 Downloads
a dingtalk robot message handle for send message
stil/curl-easy
194229 Downloads
cURL wrapper for PHP. Supports parallel and non-blocking requests. For high speed crawling, see stil/curl-robot.
monperrus/crawler-user-agents
1518 Downloads
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
ec-europa/toolkit
204019 Downloads
Toolkit packaged for Drupal projects based on Robo.
chromatic/usher
393697 Downloads
A collection of Robo commands for use on Chromatic projects.
tractorcow/silverstripe-robots
77402 Downloads
Simple robots generation module for Silverstripe
tomverran/robots-txt-checker
39481 Downloads
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page
thinkshout/robo-drupal
94489 Downloads
Robo Tasks for Drupal projects
robertboloc/robo-phinx
16484 Downloads
Phinx integration with Robo task runner
nuvoleweb/robo-config
198395 Downloads
CI/developer-friendly configuration processor for Robo.
mguinea/laravel-robots
40681 Downloads
Laravel package to manage robots in an easy way
lullabot/robo-acquia
70075 Downloads
A Robo task runner for the Acquia Cloud API.