Libraries tagged by x-robots-tag
vipnytt/useragentparser
2 Favers
822258 Downloads
822258 Downloads
User-Agent parser for robot rule sets
fourlabs/robots-bundle
2 Favers
22941 Downloads
22941 Downloads
Symfony2 bundle to control X-Robots-Tag HTTP header via annotations
nickmoline/robots-checker
2 Favers
832 Downloads
832 Downloads
Class to check a URL for robots exclusion using all possible methods of robots exclusion
locaine/lcn-x-robots-tag-bundle
1 Favers
24 Downloads
24 Downloads
Easily control X-Robots-Tag HTTP Headers
vipnytt/robotstagparser
3 Favers
367 Downloads
367 Downloads
X-Robots-Tag HTTP header parser class
su-sws/nobots
1 Favers
43959 Downloads
43959 Downloads
This module blocks (well-behaved) search engine robots from crawling, indexing, or archiving your site by setting a "X-Robots-Tag: noindex,nofollow,noarchive" HTTP header.