Download the PHP package friends-of-hyva/magento2-crawler-session without Composer
On this page you can find all versions of the php package friends-of-hyva/magento2-crawler-session. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download friends-of-hyva/magento2-crawler-session
More information about friends-of-hyva/magento2-crawler-session
Files in friends-of-hyva/magento2-crawler-session
Package magento2-crawler-session
Short Description Prevent crawlers from creating a session
License MIT
Homepage https://github.com/friends-of-hyva/magento2-crawler-session
Informations about the package magento2-crawler-session
Magento 2 - Crawler Session
Prevent crawlers from creating a session!
It's insane how many requests are coming from crawlers & bots nowadays. Every request creates an unnecessary session. If you block the SEO tools via robots.txt there are still plenty of search engines left. 100 requests per minute is not unusal. This leads to a lot of sessions which could affect some limits like Redis "max_concurrency".
This module prevents the initiation of a session if a crawler is detected. The detection is based on:
https://github.com/JayBizzle/Crawler-Detect
Installation
Install the package via composer:
Usage
After installation, you need to enable the module:
Configuration
Enabled
If enabled, the detected crawler will no longer create a session.
Additional Blacklist
If the provided list from crawlerdetect.io is not enough, you can define your own custom user agents here.
Whitelist
For situations where you need to allow a user agent that is blacklisted, you can do so here.
Log
If enabled all blocked user agents are logged to . But this is only intended for temporary debugging purposes. The filesize can get big very fast!