Libraries tagged by x-robots-tag

vipnytt/useragentparser

2 Favers
880306 Downloads

User-Agent parser for robot rule sets

nickmoline/robots-checker

2 Favers
864 Downloads

Class to check a URL for robots exclusion using all possible methods of robots exclusion

fourlabs/robots-bundle

2 Favers
23751 Downloads

Symfony2 bundle to control X-Robots-Tag HTTP header via annotations

locaine/lcn-x-robots-tag-bundle

1 Favers
25 Downloads

Easily control X-Robots-Tag HTTP Headers

vipnytt/robotstagparser

3 Favers
368 Downloads

X-Robots-Tag HTTP header parser class

su-sws/nobots

1 Favers
43960 Downloads

This module blocks (well-behaved) search engine robots from crawling, indexing, or archiving your site by setting a "X-Robots-Tag: noindex,nofollow,noarchive" HTTP header.