Download the PHP package tractorcow/silverstripe-robots without Composer
On this page you can find all versions of the php package tractorcow/silverstripe-robots. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download tractorcow/silverstripe-robots
More information about tractorcow/silverstripe-robots
Files in tractorcow/silverstripe-robots
Package silverstripe-robots
Short Description Simple robots generation module for Silverstripe
License BSD-3-Clause
Informations about the package silverstripe-robots
Robots.txt generation module for Silverstripe
This module provides simple robots.txt generation for Silverstripe, with various configuration options available.
When a site is not in live mode (such as on a testing domain) it will respectively block the entire domain, ensuring that (at least respectful) search engines will refrain from indexing your test site.
This doesn't support complex rules (such as multiple rules for different user agents), as it's designed to cater to the 99.9% of cases which won't require manual configuration.
Credits and Authors
- Damian Mooyman - https://github.com/tractorcow/silverstripe-robots
Requirements
- Silverstripe 4 or above
Installation Instructions
-
Extract all files into the 'robots' folder under your Silverstripe root, or install using composer
- Make sure you are correctly setting your environment for it to work properly
- It's also advisable to either install the googlesitemaps module, or to create a physical
sitemap.xml
in your site root.
Configuration
You can add a page or pattern to be blocked by adding it to the disallowedUrls configuration
Also by default, any page with 'ShowInSearch' set to false will also be excluded. This can be useful for hiding auxilary pages like "thanks for signing up", or error pages.
You can turn this off (if you really absolutely think you need to) using the below
By default the module will check for a sitemap file in /sitemap.xml
, or will assume
one is there if the googlesitemap module is installed. You can set a custom file location
using the below configuration.
Need more help?
Message or email me at [email protected] or, well, read the code!
License
Copyright (c) 2013, Damian Mooyman All rights reserved.
All rights reserved.
Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:
- Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.
- Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.
- The name of Damian Mooyman may not be used to endorse or promote products derived from this software without specific prior written permission.
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
DISCLAIMED. IN NO EVENT SHALL