Libraries tagged by robotstxt
mkcg/php-query-model
1198 Downloads
Agnostic model to efficiently query and scroll any kind of data (SQL, Search engine, HTTP API, CSV, ...) and push them anywhere with a ETL
hettiger/seo-aggregator
368 Downloads
Generate sitemap.xml and robots.txt files in Laravel or any PHP Application with ease.
diggin/diggin-robotrules
184 Downloads
parser/handler for Robots Exclusion Protocol (robots.txt and more)
bnomei/kirby3-htmlhead
3355 Downloads
Kirby 3 Plugin for a best-practice HTML Head Element extendable with snippets.
glow/robots
1309 Downloads
Robots.txt parser and generator toolset
phrozenbyte/pico-robots
800 Downloads
This is Pico's official robots plugin to add a robots.txt and sitemap.xml to your website. Pico is a stupidly simple, blazing fast, flat file CMS.
nyx-solutions/yii2-nyx-robots
73 Downloads
Yii2 Robots.txt Generator Module
mwdelaney/add-sitemap-to-robots
9116 Downloads
Add typical XML sitemap to robots.txt
arcanedev/robots
597 Downloads
Robots.txt generator
mortola/behat-seo-contexts
5287 Downloads
Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang, meta robots, robots.txt, redirects, sitemap validation, HTML validation, performance...
m6web/roboxt
572 Downloads
lib used for parsing a robots.txt file
tekord/robots-txt-provider
3 Downloads
Provides various framework-agnostic ways to generate the contents of the robots.txt file
spotman/kohana-robots.txt
8 Downloads
Kohana module for providing robots.txt file
rotassator/silverstripe-subsites-robotstxt
758 Downloads
Generate custom robots.txt for subsites
ricbra/robots-txt-bundle
5484 Downloads
Simple Symfony2 which generates robots.txt based on config setting