Libraries tagged by php crawler
jaybizzle/crawler-detect
110347950 Downloads
CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
jaybizzle/laravel-crawler-detect
2895535 Downloads
A Laravel package to detect web crawlers via the user agent
jaeger/querylist
671741 Downloads
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫),基于phpQuery。
vdb/php-spider
188873 Downloads
A configurable and extensible PHP web spider
spekulatius/phpscraper
165639 Downloads
PHPScraper, built with simplicity in mind. See tests/ for more examples.
crawlbase/crawlbase
66816 Downloads
A lightweight, dependency free PHP class that acts as wrapper for Crawlbase API
proxycrawl/proxycrawl
109999 Downloads
A lightweight, dependency free PHP class that acts as wrapper for ProxyCrawl API
smochin/instagram-php-crawler
10823 Downloads
A simple PHP Crawler for Instagram
helgesverre/firecrawl-php-sdk
15306 Downloads
PHP SDK for Firecrawl API - Web scraping and crawling service
eddieace/php-simple
66343 Downloads
opensearchserver/opensearchserver
68454 Downloads
PHP library for OpenSearchServer: professionnal search engine, crawlers (web, file, database), REST APIs, .... This library uses OpenSearchServer's V2 API.
nucleos/lastfm
13909 Downloads
Last.fm webservice client for php.
fkrzski/robots-txt
2999 Downloads
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
elboletaire/crawler
6756 Downloads
A simple crawler (spider) writen in php just for fun
szczyglis/php-ultra-small-proxy
306 Downloads
Lightweight proxy with full support for sessions, cookies, POST/FORM submissions, and URL rewriting.