Libraries tagged by web crawling

An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies. PHP5+

Go to Download

Web crawling and scraping library.

Go to Download

Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping

Go to Download

A small PHP app to protect your site against DDoS attack or crawling web site by bots.

Go to Download

Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web search and testing solution. It can be used for a wide range of purposes, from extracting and indexing structured data to monitoring and automated testing.

Go to Download

Just another curl wrapper for webCrawling purposes

Go to Download

A web scraper for PHP to easily extract data from web pages

Go to Download

A web scraper for PHP to easily extract data from web pages

Go to Download

A generic rate limiter for the web and reactphp. Useful for API clients, web crawling, or other tasks that need to be throttled

Go to Download

Universal package for BrightData web scraping and crawling. And making keyword research easier.

Go to Download

A web crawler package

Go to Download

A web crawling framework in PHP

Go to Download

An easy-to-use PHP class for scraping webpages' source code.

Go to Download

Crawles web pages

Go to Download

Just another curl wrapper for webCrawling purposes (pthreads modified)

Go to Download