Libraries tagged by robotstxt
tekord/robots-txt-provider
4 Downloads
Provides various framework-agnostic ways to generate the contents of the robots.txt file
spotman/kohana-robots.txt
10 Downloads
Kohana module for providing robots.txt file
rotassator/silverstripe-subsites-robotstxt
769 Downloads
Generate custom robots.txt for subsites
ricbra/robots-txt-bundle
5488 Downloads
Simple Symfony2 which generates robots.txt based on config setting
ranvis/robots-txt-processor-test
3 Downloads
robots.txt processor feature/behavior test.
ranvis/robots-txt-processor
22 Downloads
robots.txt filter and tester for untrusted source.
miisieq/robots-txt-bundle
2507 Downloads
Robots.txt generator for Symfony 2, 3 & 4
jmajors/robotstxt
23 Downloads
A small package for parsing websites' robots.txt files
innomedia/silverstripe-robots-txt
1 Downloads
A modern, dynamic robots.txt module for SilverStripe
daikazu/robotstxt
262 Downloads
Dynamically generate robots.txt content based on the current Laravel environment.
cybercog/robots-txt
2402 Downloads
Robots.txt Generator
b1tc0re/robots-txt
38 Downloads
Generator robots.txt
andronof/robotstxt
73 Downloads
Parse robots.txt
itinerisltd/add-yoast-seo-sitemap-to-robots-txt
17142 Downloads
Add Yoast SEO Sitemap to robots.txt
hofff/contao-robots-txt-editor
123 Downloads
Editor for auto creation and modification of robots.txt.