Libraries tagged by crawler detect

Fork of https://github.com/JayBizzle/Crawler-Detect/ with PHP 8.4 warnings fixed

Go to Download

Fat-free, standalone and fast web crawler (bot) detector

Go to Download

Generic Scrapy-like web crawler for Laravel — auto-detects lists, pagination, fields, and supports API/SPA, infinite scroll, image downloading, dedup, resumable crawls, and pluggable output sinks.

Go to Download

Enhanced user agent parser for Laravel

Go to Download

Detect robots and crawlers.

Go to Download

Protect your Laravel app from AI scrapers, LLM crawlers, and prompt injection attacks

Go to Download

This module blocks all kind of bots / crawlers / spiders.

Go to Download

Marked Down serves Markdown to AI crawlers, command-line tools, and APIs while browsers get HTML. Zero-config per-section setup, automatic AI bot detection, .md URL suffix, /llms.txt, YAML front matter, and dedicated Markdown templates — out of the box.

Go to Download

Go to Download

A Symfony 2 crawler detect bundle

Go to Download

PHP SDK for the YEB Bot Detection API. Detect bots, crawlers and automated traffic.

Go to Download

Detect Seznam.cz bot crawling websites. Detection for page crawler and thumbnail screening bot.

Go to Download

Logs each request made by Google crawlers.

Go to Download

This bundle provides console command that detects broken links on your website.

Go to Download

A PHP desktop/mobile user agent parser with bot detection, based on Mobiledetect and CrawlerDetect.

Go to Download