Libraries tagged by robotstxt

sonhb99/robots-txt

0 Favers
4 Downloads

Determine if a page may be crawled from robots.txt and robots meta tags

monsieurbiz/mbiz_robotstxt

0 Favers
152 Downloads

Magento extension to edit robots.txt from the admin panel.

innmind/robots-txt

0 Favers
415 Downloads

Robots.txt parser

hugsbrugs/php-robots-txt

0 Favers
35 Downloads

PHP Robots.txt Utilities

boomcms/boom-robotstxt

0 Favers
859 Downloads

robots.txt generator for BoomCMS

codeinc/robots-txt-middleware

0 Favers
29 Downloads

A PSR-15 middleware to answers /robots.txt requests

bisarca/robots-txt

1 Favers
54 Downloads

Robots.txt Component

wdmg/yii2-robots

0 Favers
402 Downloads

Module for automatically generating and edit the robots.txt file

vipnytt/robotstagparser

3 Favers
367 Downloads

X-Robots-Tag HTTP header parser class

vipnytt/cleanparam-url-filter

3 Favers
73 Downloads

Clean-Param URL filtering class - Find and remove any duplicate URL

thanatos-vf-2000/ct4gg

0 Favers
2 Downloads

Wordpress customiser tools for beginer and confirmed users.

steein/robots

2 Favers
6328 Downloads

Generator robots.txt

samkitano/seo-gen

1 Favers
12 Downloads

Generate sitemap.xml and robots.txt files in Laravel 4.2 with support for multi-language. Based on Hettiger/SeoAggregator

nickdekruijk/laravel-robots

1 Favers
9 Downloads

Dynamic robots.txt files for Laravel projects

mgargano/non-production-robots-ignore

3 Favers
2436 Downloads

Non Production Robots Ignore is a simple WordPress plugin that is used with vlucas/phpdotenv (or similar) that sets environment variables to set robots.txt to ignore all on all environments except production.

<< Previous Next >>