Libraries tagged by spyder
dypa/phpmulticurl
26196 Downloads
Ultra fast non-blocking OOP wrapper for curl_multi_* functions.
crwlr/robots-txt
13996 Downloads
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
jyggen/curl
144791 Downloads
A simple and lightweight cURL library with support for asynchronous requests.
shjia/taobao_spider
837 Downloads
淘宝、天猫商品爬虫
veqryn/curl
28286 Downloads
PHP Wrapper for Curl
nucleos/lastfm
11947 Downloads
Last.fm webservice client for php.
mediamonks/crawler
764 Downloads
Crawl your own website with various clients for SEO and indexing purposes.
blogdaren/phpcreeper
824 Downloads
A new generation of multi-process async event-driven spider engine based on Workerman
codeguy/arachnid
9729 Downloads
A crawler to find all unique internal pages on a given website
xcrawler/xcrawler
876 Downloads
A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架
bugbuster/contao-botdetection-bundle
36626 Downloads
Contao bundle helper class to detect search engines, bots, spiders, crawlers ...
stuttter/wp-spider-cache
1203 Downloads
Your friendly neighborhood caching solution for WordPress
sofyco/spider-bundle
232 Downloads
Symfony Spider Bundle
sofyco/spider
270 Downloads
Crawler + Scraper + Parser library
openbuildings/spiderling
134214 Downloads
Crawl the web with kohana or phantomjs.