Libraries tagged by Rubot

Rubot is a PHP framework for building Rubika bots efficiently and reliably, with full support for messaging, media, and user interactions.Rubot - Rubika Bot API SDK in PHP

Go to Download

Rubing Library for rubika bots

Go to Download

Determine if a page may be crawled from robots.txt and robots meta tags

Go to Download

🍀 Nette RobotLoader: autoloads every class, interface, trait and enum in your directories, with no PSR-4 and no naming rules, and remembers where it found them.

Go to Download

Add an `all` or `none` robots header to your requests via a middleware in Laravel

Go to Download

XML Sitemap parser class compliant with the Sitemaps.org protocol.

Go to Download

Models a robots.txt file

Go to Download

Set the robots.txt content dynamically based on the Laravel app environment.

Go to Download

PHP Class for parsing robots.txt files according to Google, Yandex specifications.

Go to Download

cURL wrapper for PHP. Supports parallel and non-blocking requests. For high speed crawling, see stil/curl-robot.

Go to Download

This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.

Go to Download

Robots.txt parsing library, with full support for every directive and specification.

Go to Download

Simple robots generation module for Silverstripe

Go to Download

PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.

Go to Download

Automated tests for the Robot Framework

Go to Download