Libraries tagged by web crawler
brunodebarros/http-request
207 Downloads
A web crawler, built to be easily dropped into PHP applications, which behaves just like a regular web browser, interpreting location redirects and storing cookies automatically.
arraypress/wp-useragent-utils
6 Downloads
A lean PHP library for user agent detection, browser identification, device type detection, and bot recognition with modern browser support
appstract/laravel-crawl-render
37 Downloads
Pre-render your site for web crawlers
webcrawlerapi/sdk
13 Downloads
A PHP SDK for WebCrawler API - turn website into data
revolution/salvager
5535 Downloads
WebCrawler build with Laravel Dusk and Symfony DomCrawler
szczyglis/php-ultra-small-proxy
228 Downloads
Lightweight proxy with full support for sessions, cookies, POST/FORM submissions, and URL rewriting.
pagemunch/pagemunch
31 Downloads
A PHP wrapper for the PageMunch link unfurling API
laurentvw/scrapher
2529 Downloads
A web scraper for PHP to easily extract data from web pages
laurentvw/lavacrawler
97 Downloads
A web scraper for PHP to easily extract data from web pages
ssola/crawly
18 Downloads
Simple web crawler library
giordanolima/loterias-api
283 Downloads
Web crawler para buscar os resultados das loterias da caixa
aliasio/aranea
15 Downloads
A general purpose web crawler
alapi/querylist
634 Downloads
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫)，基于phpQuery。
simgroep/concurrent-spider-bundle
177 Downloads
Symfony bundle for running a distributed web page crawler
zanysoft/laravel-crawler-detect
365 Downloads
A Laravel package to detect web crawlers via the user agent