Libraries tagged by crawlers
flancer32/mage2_ext_bot_sess
10884 Downloads
Magento2: prevent session creation for bots & crawlers.
nadar/crawler
21876 Downloads
A highly extendible, dependency free Crawler for HTML, PDFS or any other type of Documents.
mediamonks/crawler
1030 Downloads
Crawl your own website with various clients for SEO and indexing purposes.
alikdex/yii2-crawler-detect
20364 Downloads
Yii2 extension for CrawlerDetect library
webignition/symfony-panther-dom-crawler-navigator
7700 Downloads
Navigate around a symfony panther dom crawler using convenience methods
rebelinblue/fluent-web-crawler
3585 Downloads
A web crawler with a fluent interface
katsana/dusk-crawler
12400 Downloads
Web Crawler using Laravel Dusk
hacoidev/ophim-crawler
4261 Downloads
ophim crawler
nucleos/lastfm
12024 Downloads
Last.fm webservice client for php.
lobotomised/laravel-autocrawler
33463 Downloads
A tool to crawl your own laravel installation checking your HTTP status codes
kiddyu/beanbun
4096 Downloads
Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性
crawlzone/crawlzone
5229 Downloads
Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web search and testing solution. It can be used for a wide range of purposes, from extracting and indexing structured data to monitoring and automated testing.
bvp/boatrace-scraper
8332 Downloads
The BVP Boatrace Scraper package for Boatrace.
blogdaren/phpcreeper
852 Downloads
A new generation of multi-process async event-driven spider engine based on Workerman
blackfire/player
16285 Downloads
A powerful web crawler and web scraper with Blackfire support