Libraries tagged by cradle
proxycrawl/proxycrawl
85110 Downloads
A lightweight, dependency free PHP class that acts as wrapper for ProxyCrawl API
jyggen/curl
145975 Downloads
A simple and lightweight cURL library with support for asynchronous requests.
schliesser/sitecrawler
27356 Downloads
TYPO3 sitemap crawler
flancer32/mage2_ext_bot_sess
10893 Downloads
Magento2: prevent session creation for bots & crawlers.
webignition/symfony-panther-dom-crawler-navigator
7817 Downloads
Navigate around a symfony panther dom crawler using convenience methods
rebelinblue/fluent-web-crawler
3585 Downloads
A web crawler with a fluent interface
philiplb/crudlex
6166 Downloads
An easy to use CRUD generator for Silex and Symfony 4.
nadar/crawler
21905 Downloads
A highly extendible, dependency free Crawler for HTML, PDFS or any other type of Documents.
mediamonks/crawler
1039 Downloads
Crawl your own website with various clients for SEO and indexing purposes.
katsana/dusk-crawler
12404 Downloads
Web Crawler using Laravel Dusk
hacoidev/ophim-crawler
4265 Downloads
ophim crawler
alikdex/yii2-crawler-detect
20371 Downloads
Yii2 extension for CrawlerDetect library
nucleos/lastfm
12039 Downloads
Last.fm webservice client for php.
lobotomised/laravel-autocrawler
33605 Downloads
A tool to crawl your own laravel installation checking your HTTP status codes
kiddyu/beanbun
4096 Downloads
Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性