Libraries tagged by spyder
walkerspider/filemanager
9 Downloads
ManagerFile retrieving and manipulating data as wished.
vipnytt/robotstagparser
368 Downloads
X-Robots-Tag HTTP header parser class
vangxh/beanbun
2 Downloads
Beanbun 是用 PHP 编写的多进程网络爬虫框架,具有良好的开放性、高可扩展性
ucaime/xformat
7 Downloads
快速格式化采集的站点内容
toulen/tspider
6 Downloads
spider with php cli
thewinterwind/arachnid
10 Downloads
A crawler to find all unique internal pages on a given website
tallesairan/crawler
7 Downloads
Most powerful, popular and production crawling/scraping package for PHP
spyserp/phpclient
1280 Downloads
Client API for Spyserp.com
spark-laravel/querylist
7 Downloads
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫),基于phpQuery。
sockstack/querylist
42 Downloads
Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫),基于phpQuery。
snippetify/laravel-sniptbot
4 Downloads
Sniptbot for laravel
sngrl/mcurl
63 Downloads
wrap curl client (http client) for PHP 5.3+; using php multi curl, parallel request and write asynchronous code
sjdskl/webspider
14 Downloads
web spider
showx/phpspiderman
0 Downloads
phpspiderman是网络爬虫框架
ricbra/robots-txt-bundle
5488 Downloads
Simple Symfony2 which generates robots.txt based on config setting