Libraries tagged by php crawler
jaybizzle/crawler-detect
102028923 Downloads
CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
jaybizzle/laravel-crawler-detect
2683921 Downloads
A Laravel package to detect web crawlers via the user agent
jaeger/querylist
653098 Downloads
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫),基于phpQuery。
vdb/php-spider
184488 Downloads
A configurable and extensible PHP web spider
spekulatius/phpscraper
151257 Downloads
PHPScraper, built with simplicity in mind. See tests/ for more examples.
crawlbase/crawlbase
56956 Downloads
A lightweight, dependency free PHP class that acts as wrapper for Crawlbase API
proxycrawl/proxycrawl
103054 Downloads
A lightweight, dependency free PHP class that acts as wrapper for ProxyCrawl API
smochin/instagram-php-crawler
10214 Downloads
A simple PHP Crawler for Instagram
helgesverre/firecrawl-php-sdk
12136 Downloads
PHP SDK for Firecrawl API - Web scraping and crawling service
eddieace/php-simple
63806 Downloads
opensearchserver/opensearchserver
67929 Downloads
PHP library for OpenSearchServer: professionnal search engine, crawlers (web, file, database), REST APIs, .... This library uses OpenSearchServer's V2 API.
luyadev/luya-module-crawler
33858 Downloads
An full search page crawler to enable complex and customized searching abilities.
nucleos/lastfm
13280 Downloads
Last.fm webservice client for php.
kiddyu/beanbun
4117 Downloads
Beanbun 是用 PHP 编写的多进程网络爬虫框架,具有良好的开放性、高可扩展性
iprodev/sitemap-generator-pro
56 Downloads
A professional, production-ready PHP XML sitemap generator with advanced features: concurrency, robots.txt, caching, database storage, change detection, SEO analysis, JavaScript rendering, proxy support, webhooks, and more.