Libraries tagged by spyder
w3zone/crawler
116 Downloads
ropendev/curl
6430 Downloads
PHP POO cURL wrapper (PSR friendly) : light and simple.
peteryang/querylist
98 Downloads
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫)，基于phpQuery。
mihaeu/tarantula
50 Downloads
Another PHP crawler based on Guzzle.
mediamonks/crawler-bundle
44 Downloads
Integrates the mediamonks/crawler package into Symfony
laurentvw/scrapher
2529 Downloads
A web scraper for PHP to easily extract data from web pages
diggin/diggin-robotrules
187 Downloads
parser/handler for Robots Exclusion Protocol (robots.txt and more)
blogdaren/webman-phpcreeper
306 Downloads
PHPCreeper plugin for webman
phantazm/robotdetector
1872 Downloads
Detect robots and crawlers.
laurentvw/lavacrawler
97 Downloads
A web scraper for PHP to easily extract data from web pages
gpupo/camelspider
1 Downloads
A class to help handle gateways to processing entities.
core23/lastfm-api
2785 Downloads
Last.fm webservice client for php.
hypchina/phpspider
24 Downloads
php爬虫,spider,协程
esyon/crawlerblock
847 Downloads
This module blocks all kind of bots / crawlers / spiders.
codeblog/crawlerdetect
55 Downloads
A CodeBlog CrawlerDetect class is easy and quick to use. Detecting bots/crawlers/spiders via the user agent!