Libraries tagged by crawling

Most powerful, popular and production crawling/scraping package for PHP

Go to Download

Class to help with crawling web pages

Go to Download

cURL wrapper for PHP. Supports parallel and non-blocking requests. For high speed crawling, see stil/curl-robot.

Go to Download

Browser emulator, for crawling web pages

Go to Download

This is a Wrapper for the API provided by most Wordpress Blogs. Intended for easy crawling of a Wordpress page.

Go to Download

Sigmie Crawler is a PHP package for crawling websites and exporting their HTML contents.

Go to Download

Ant: For 4chan image crawling

Go to Download

Webcrawler for crawling indexed sites i.e. options and indexes

Go to Download

a library for crawling search engine results and extracting metadata for a set of keywords

Go to Download

Nashor is a fast high-level web crawling and web scraping tool for OP.GG

Go to Download

Crawling rules processor

Go to Download

Laravel-Goutte is a laravel service container wrapper for FriendsOfPHP Goutte Package which is a screen scraping and web crawling library for PHP.

Go to Download

a search engine crawling tool that extracts metadata for a set of keywords.

Go to Download

Toolkit that helps in creating custom APIs using cURL HTTP requests and crawling thru the DOM

Go to Download

A quick-start helper to website crawling.

Go to Download