Libraries tagged by x-robots-tag

vipnytt/useragentparser

2 Favers
862621 Downloads

User-Agent parser for robot rule sets

nickmoline/robots-checker

2 Favers
853 Downloads

Class to check a URL for robots exclusion using all possible methods of robots exclusion

locaine/lcn-x-robots-tag-bundle

1 Favers
25 Downloads

Easily control X-Robots-Tag HTTP Headers

vipnytt/robotstagparser

3 Favers
368 Downloads

X-Robots-Tag HTTP header parser class

fourlabs/robots-bundle

2 Favers
23728 Downloads

Symfony2 bundle to control X-Robots-Tag HTTP header via annotations

su-sws/nobots

1 Favers
43960 Downloads

This module blocks (well-behaved) search engine robots from crawling, indexing, or archiving your site by setting a "X-Robots-Tag: noindex,nofollow,noarchive" HTTP header.