Download the PHP package innoweb/silverstripe-robots without Composer
On this page you can find all versions of the php package innoweb/silverstripe-robots. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download innoweb/silverstripe-robots
More information about innoweb/silverstripe-robots
Files in innoweb/silverstripe-robots
Package silverstripe-robots
Short Description Adds a Robots.txt file that is configurable from /admin/settings/.
License BSD-3-Clause
Homepage https://github.com/xini/silverstripe-robots
Informations about the package silverstripe-robots
Silverstripe Robots.txt
Overview
Adds a Robots.txt file that is configurable from /admin/settings/ and injects robots meta tag into all pages.
This module supports single site as well as multisites and configured-multisites setups.
Requirements
- Silverstripe CMS 5.x
Note: this version is compatible with SilverStripe 5. For SilverStripe 4, please see the 4 release line.
Installation
Install the module using composer:
Then run dev/build.
Configuration
Robots.txt
On the SiteConfig (or Site if Multisites is installed) there is a setting in the CMS that lets you set the robots mode. The three options are:
- Allow all
- Disallow all
- Custom content
The output of all three states is managed through templates and can be overwritten for an app or theme.
You can force the state using the following .env
variable (e.g. for dev or test environment):
Allow all
When switched to 'allow all' the module uses the template Innoweb/Robots/RobotsController_allow.ss
with the following default content:
The module checks whether the Google Sitemaps module is installed and injects the sitemap URL automatically.
It allows access to all pages and disallows access to development and security URLs by default.
Disallow all
When switched to 'disallow all' the module uses the template Innoweb/Robots/RobotsController_disallow.ss
with the following default content:
This disallows all robots from accessing any page on the site.
Custom content
This setting reveals a text field in the CMS where custom code can be entered.
The template contains the following code and doesn't add anything to the custom code entered:
A good standard robots.txt configuration for Silverstripe looks as follows. This is used as default when the module is switched to 'allow all':
Robots meta tag
The module injects a robots meta tag into every page. The injection of the meta tag can be disabled using the following config, e.g. if the robots meta tag is managed manually in the template:
By default, all pages are set to index, follow
with the following exceptions:
- The Robots.txt setting on the site if set to 'Disallow all'
- The environment is set to
test
ordev
- The current page is displayed by the Security controller
- The Priority setting for the page is
-1
(see Google Sitemaps module)
Additionally, for each page type a config value can be set to control the meta tag. By default, the following values are set:
This can be customised for any custom page types as needed.
License
BSD 3-Clause License, see License