Libraries tagged by robodt
robodt/robodt
84 Downloads
Flexible and lightweight file-based markdown CMS
robodt/light-edition
58 Downloads
Robodt Markdown CMS - Light Edition
robodt/adapter-fw-slim
68 Downloads
Robodt Slim Framework Adapter
nette/robot-loader
55874090 Downloads
🍀 Nette RobotLoader: high performance and comfortable autoloader that will search and autoload classes within your application.
spatie/robots-txt
19548866 Downloads
Determine if a page may be crawled from robots.txt and robots meta tags
spatie/laravel-robots-middleware
2315464 Downloads
Add an `all` or `none` robots header to your requests via a middleware in Laravel
vipnytt/sitemapparser
2404074 Downloads
XML Sitemap parser class compliant with the Sitemaps.org protocol.
webignition/robots-txt-file
1445674 Downloads
Models a robots.txt file
bopoda/robots-txt-parser
300582 Downloads
PHP Class for parsing robots.txt files according to Google, Yandex specifications.
monperrus/crawler-user-agents
6566 Downloads
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
vipnytt/robotstxtparser
805403 Downloads
Robots.txt parsing library, with full support for every directive and specification.
verschuur/laravel-robotstxt
438616 Downloads
Set the robots.txt content dynamically based on the Laravel app environment.
t1gor/robots-txt-parser
504131 Downloads
PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.
mage-os/module-meta-robots-tag
22243 Downloads
NoIndex NoFollow NoArchive Tag extension
healey/robots
210565 Downloads
Robots.txt Generator for Laravel 4 and 5