Download the PHP package nerbiz/crawl-shield without Composer
On this page you can find all versions of the php package nerbiz/crawl-shield. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download nerbiz/crawl-shield
More information about nerbiz/crawl-shield
Files in nerbiz/crawl-shield
Package crawl-shield
Short Description Prevent search engine crawlers from indexing your Laravel dev/test sites
License MIT
FAQ
Example:
In general, it is recommended to use always a project to download your libraries. In an application normally there is more than one library needed.
- Some hosting areas are not accessible by a terminal or SSH. Then it is not possible to use Composer.
- To use Composer is sometimes complicated. Especially for beginners.
- Composer needs much resources. Sometimes they are not available on a simple webspace.
- If you are using private repositories you don't need to share your credentials. You can set up everything on our site and then you provide a simple download link to your team member.
- Simplify your Composer build process. Use our own command line tool to download the vendor folder as binary. This makes your build process faster and you don't need to expose your credentials for private repositories.
Informations about the package crawl-shield
Crawl Shield
A lightweight Laravel package that restricts access to your application using a simple URL parameter.
Crawl Shield helps keep unwanted visitors and search engine crawlers out, while allowing visitors with the correct parameter to browse freely once access has been granted.
⚠️ Warning: Crawl Shield is not a security solution. It discourages unwanted access but does not protect sensitive information or guarantee exclusion from search results.
Installation
Configuration
Crawl Shield works out of the box. To customise its behaviour, add any of the following variables to your .env file:
These are the default values. You are strongly advised to change CRAWL_SHIELD_PARAMETER and CRAWL_SHIELD_PASSWORD in your .env file, as the defaults are publicly known.
You can optionally publish the configuration file:
This is not required, because all settings can be customised through environment variables.
Middleware registration
Register the middleware in bootstrap/app.php using one of the following approaches.
Option 1: Web routes (recommended)
Protect all routes using Laravel's web middleware group:
Option 2: Specific routes
Register an alias in bootstrap/app.php:
Then apply it to individual routes or groups:
These routes must use Laravel's web middleware group for session support.
Usage
Without the correct query parameter, visitors receive an HTTP 403 Forbidden response.
To gain access, visit:
Access is then remembered in the session, so the parameter isn't needed for subsequent requests.
Crawl Shield is disabled in production by default.
Limitations
Crawl Shield is a convenience barrier, not authentication. Anyone with the correct parameter can gain access, and the parameter may appear in browser history, logs or shared URLs.
Although crawlers receive a 403 response, this does not guarantee that URLs won't appear in search results.
For sensitive environments, use proper authentication or network-level access restrictions.
