Libraries tagged by robotstxt

tourze/robots-txt-bundle
0 Favers
0 Downloads

robots.txt管理

Go to Download

text-media/robotstxt-parser
0 Favers
107 Downloads

Go to Download

sonhb99/robots-txt
0 Favers
4 Downloads

Determine if a page may be crawled from robots.txt and robots meta tags

Go to Download

odorisioe/silverstripe-robots-txt
0 Favers
2618 Downloads

Feature to manage the robots.txt on SilverStripe

Go to Download

monsieurbiz/mbiz_robotstxt
0 Favers
152 Downloads

Magento extension to edit robots.txt from the admin panel.

Go to Download

leopoletto/robots-txt-parser
1 Favers
33 Downloads

A comprehensive PHP package for parsing robots.txt files, including support for meta tags and X-Robots-Tag HTTP headers

Go to Download

innmind/robots-txt
0 Favers
424 Downloads

Robots.txt parser

Go to Download

hugsbrugs/php-robots-txt
0 Favers
35 Downloads

PHP Robots.txt Utilities

Go to Download

dissnik/robots-txt
0 Favers
0 Downloads

robots.txt management for Laravel

Go to Download

cgoit/contao-robots-txt-bundle
0 Favers
46 Downloads

Gives you the option to use a centralized robots.txt configuration for multiple contao installations.

Go to Download

boomcms/boom-robotstxt
0 Favers
870 Downloads

robots.txt generator for BoomCMS

Go to Download

codeinc/robots-txt-middleware
0 Favers
29 Downloads

A PSR-15 middleware to answers /robots.txt requests

Go to Download

bisarca/robots-txt
1 Favers
54 Downloads

Robots.txt Component

Go to Download

wdmg/yii2-robots
0 Favers
436 Downloads

Module for automatically generating and edit the robots.txt file

Go to Download

vipnytt/cleanparam-url-filter
3 Favers
74 Downloads

Clean-Param URL filtering class - Find and remove any duplicate URL

Go to Download

<< Previous Next >>