Libraries tagged by crawlers

Go to Download

一个简单的API即可实现多平台文章采集，目前已接入：微信公众号，CSDN，博客园，简书，人民网，QQ新闻，百家号

Go to Download

Go to Download

Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫)，基于phpQuery。

Go to Download

Directory Crawler PHP is a simple PHP library for recursively crawling through directories and listing files and directories.

Go to Download

crawler

Go to Download

This is crawler project by John Vu

Go to Download

Crawl through website DOM, XML, JSON.

Go to Download

An extension that allows the Facebook Crawler to crawl protected pages.

Go to Download

Go to Download

crawler

Go to Download

Most powerful, popular and production crawling/scraping package for PHP

Go to Download

Class to help with crawling web pages

Go to Download

A backbone for static spiderling crawlers

Go to Download

Laravel queue based distributed web crawler framework.

Go to Download