Libraries tagged by cradle
dachcom-digital/dynamic-search-data-provider-crawler
31766 Downloads
bitandblack/document-crawler
732 Downloads
Extract different parts of an HTML or XML document.
alikdex/yii2-crawler-detect
22843 Downloads
Yii2 extension for CrawlerDetect library
elboletaire/crawler
6728 Downloads
A simple crawler (spider) writen in php just for fun
szczyglis/php-ultra-small-proxy
301 Downloads
Lightweight proxy with full support for sessions, cookies, POST/FORM submissions, and URL rewriting.
ropendev/curl
6875 Downloads
PHP POO cURL wrapper (PSR friendly) : light and simple.
revolution/salvager
10739 Downloads
Tiny WebCrawler for Laravel using Playwright
pushword/page-scanner
4772 Downloads
Find dead links, 404, 301 and more (command line or admin).
lobotomised/laravel-autocrawler
44422 Downloads
A tool to crawl your own laravel installation checking your HTTP status codes
kiddyu/beanbun
4119 Downloads
Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性
flowd/phirewall-preset-bots
451 Downloads
Bot and AI-crawler control presets for the Phirewall PHP firewall - block AI scrapers and rate-limit aggressive SEO crawlers
fkrzski/robots-txt
2827 Downloads
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
crawlzone/crawlzone
5412 Downloads
Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web search and testing solution. It can be used for a wide range of purposes, from extracting and indexing structured data to monitoring and automated testing.
blogdaren/phpcreeper
953 Downloads
A new generation of multi-process async event-driven spider engine based on Workerman
blackfire/player
17115 Downloads
A powerful web crawler and web scraper with Blackfire support