Libraries tagged by robodt
wangju/ding-notice
163678 Downloads
a dingtalk robot message handle for send message
stil/curl-easy
192575 Downloads
cURL wrapper for PHP. Supports parallel and non-blocking requests. For high speed crawling, see stil/curl-robot.
monperrus/crawler-user-agents
1388 Downloads
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
tractorcow/silverstripe-robots
75309 Downloads
Simple robots generation module for Silverstripe
tomverran/robots-txt-checker
35613 Downloads
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page
mguinea/laravel-robots
38521 Downloads
Laravel package to manage robots in an easy way
frosh/robots-txt
9289 Downloads
Generate robots.txt
crwlr/robots-txt
8569 Downloads
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
bnomei/kirby3-robots-txt
37101 Downloads
Manage the robots.txt from the Kirby config file
vipnytt/useragentparser
753426 Downloads
User-Agent parser for robot rule sets
marcortola/behat-seo-contexts
93737 Downloads
Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang, meta robots, robots.txt, redirects, sitemap validation, HTML validation, performance...
robotusers/commander
89572 Downloads
Command Bus abstraction for PHP.
robotusers/cakephp-table-inheritance
192209 Downloads
Robotusers CakePHP STI & CTI pattern plugin
robotomize/regression-php
30630 Downloads
Calculates regression
glicer/link-checker
12341 Downloads
Check broken links in html files, sitemap.xml and robots.txt