Libraries tagged by php crawler
jaybizzle/crawler-detect
78732938 Downloads
CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
jaybizzle/laravel-crawler-detect
2049181 Downloads
A Laravel package to detect web crawlers via the user agent
jaeger/querylist
604762 Downloads
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫),基于phpQuery。
vdb/php-spider
168610 Downloads
A configurable and extensible PHP web spider
spekulatius/phpscraper
110516 Downloads
PHPScraper, built with simplicity in mind. See tests/ for more examples.
smochin/instagram-php-crawler
7978 Downloads
A simple PHP Crawler for Instagram
eddieace/php-simple
52595 Downloads
opensearchserver/opensearchserver
64820 Downloads
PHP library for OpenSearchServer: professionnal search engine, crawlers (web, file, database), REST APIs, .... This library uses OpenSearchServer's V2 API.
crawlbase/crawlbase
27452 Downloads
A lightweight, dependency free PHP class that acts as wrapper for Crawlbase API
proxycrawl/proxycrawl
82366 Downloads
A lightweight, dependency free PHP class that acts as wrapper for ProxyCrawl API
szczyglis/php-ultra-small-proxy
211 Downloads
Lightweight proxy with full support for sessions, cookies, POST/FORM submissions, and URL rewriting.
kiddyu/beanbun
4093 Downloads
Beanbun 是用 PHP 编写的多进程网络爬虫框架,具有良好的开放性、高可扩展性
fkrzski/robots-txt
704 Downloads
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
xcrawler/xcrawler
879 Downloads
A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架
octopoda/octopus
4279 Downloads
PHP Sitemap crawler