Libraries tagged by php crawler
jaybizzle/crawler-detect
105565296 Downloads
CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
jaybizzle/laravel-crawler-detect
2773056 Downloads
A Laravel package to detect web crawlers via the user agent
jaeger/querylist
660525 Downloads
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫),基于phpQuery。
vdb/php-spider
186620 Downloads
A configurable and extensible PHP web spider
spekulatius/phpscraper
157058 Downloads
PHPScraper, built with simplicity in mind. See tests/ for more examples.
crawlbase/crawlbase
61569 Downloads
A lightweight, dependency free PHP class that acts as wrapper for Crawlbase API
proxycrawl/proxycrawl
106404 Downloads
A lightweight, dependency free PHP class that acts as wrapper for ProxyCrawl API
smochin/instagram-php-crawler
10488 Downloads
A simple PHP Crawler for Instagram
eddieace/php-simple
64965 Downloads
opensearchserver/opensearchserver
68047 Downloads
PHP library for OpenSearchServer: professionnal search engine, crawlers (web, file, database), REST APIs, .... This library uses OpenSearchServer's V2 API.
nucleos/lastfm
13529 Downloads
Last.fm webservice client for php.
helgesverre/firecrawl-php-sdk
13222 Downloads
PHP SDK for Firecrawl API - Web scraping and crawling service
neclimdul/coveo-push-api
3534 Downloads
The Push API allows you to *push* items and security identities, as opposed to letting standard Coveo Cloud V2 crawlers *pull* this data from a content repository. This is especially useful when you need to index content from a cloud or on-premises system for which no dedicated source type exists in the Coveo Cloud V2 platform.
kiddyu/beanbun
4118 Downloads
Beanbun 是用 PHP 编写的多进程网络爬虫框架,具有良好的开放性、高可扩展性
fkrzski/robots-txt
2011 Downloads
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience