Libraries tagged by robotstxt

mwdelaney/add-sitemap-to-robots

2 Favers
9144 Downloads

Add typical XML sitemap to robots.txt

michaeljjames/silverstripe-robots

1 Favers
98 Downloads

Adds a Robots.txt file that is configurable from /admin/settings/.

loveduckie/silverstripe-robots

0 Favers
1 Downloads

A Silverstripe module for managing the robots.txt file from the CMS.

kazak71/laravel-robots

0 Favers
3 Downloads

Robots.txt generator service.

jamesshaver/phpcrawl

1 Favers
16 Downloads

PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

iteracode/robots

0 Favers
9 Downloads

Robots.txt Shell Generator

ganey/robots

0 Favers
23 Downloads

Robots.txt Generator for Laravel 5

dawid-z/phpcrawl

1 Favers
90 Downloads

PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

beeg99/phpcrawl

0 Favers
3 Downloads

PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

bakiro/laravel-5-robots

0 Favers
7296 Downloads

Robots.txt Generator for Laravel 5

anatoliy700/yii2-robots

0 Favers
2 Downloads

Implements a dynamic robots.txt file

nox-it/yii2-nox-robots

1 Favers
373 Downloads

Yii2 Robots.txt Generator Module

thepoddi/kirby3-seokit

5 Favers
10 Downloads

SEO Kit for Kirby 3 including sitemap.xml and robotx.txt

melisplatform/melis-cms-site-robot

1 Favers
2079 Downloads

This module adds the dynamic generation of the robot.txt file to a tool and per site

<< Previous