Libraries tagged by robot
nette/robot-loader
47226327 Downloads
🍀 Nette RobotLoader: high performance and comfortable autoloader that will search and autoload classes within your application.
spatie/robots-txt
12637463 Downloads
Determine if a page may be crawled from robots.txt and robots meta tags
spatie/laravel-robots-middleware
1816700 Downloads
Add an `all` or `none` robots header to your requests via a middleware in Laravel
webignition/robots-txt-file
1114664 Downloads
Models a robots.txt file
verschuur/laravel-robotstxt
340363 Downloads
Set the robots.txt content dynamically based on the Laravel app environment.
vipnytt/sitemapparser
1812090 Downloads
XML Sitemap parser class compliant with the Sitemaps.org protocol.
monperrus/crawler-user-agents
2434 Downloads
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
vipnytt/robotstxtparser
696049 Downloads
Robots.txt parsing library, with full support for every directive and specification.
healey/robots
194761 Downloads
Robots.txt Generator for Laravel 4 and 5
t1gor/robots-txt-parser
482764 Downloads
PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.
spryker/robotframework-suite-tests
76011 Downloads
Automated tests for the Robot Framework
bopoda/robots-txt-parser
210158 Downloads
PHP Class for parsing robots.txt files according to Google, Yandex specifications.
marcortola/behat-seo-contexts
128809 Downloads
Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang, meta robots, robots.txt, redirects, sitemap validation, HTML validation, performance...
novactive/ezseobundle
238043 Downloads
Novactive eZ SEO Bundle is an Ibexa Platform bundle for SEO simplications. metas, sitemaps, robots.txt, etc.
wangju/ding-notice
176444 Downloads
a dingtalk robot message handle for send message