Libraries tagged by web crawling

Just another curl wrapper for webCrawling purposes (pthreads modified)

Go to Download

Official PHP SDK for Spidra — AI-powered web scraping and crawling

Go to Download

PHP web scraping and crawling library. With support for multiple clients, fast parsing, debugging and on the fly changes to various options

Go to Download

Crawling and scraping web pages to extract snippets

Go to Download

Web scraping library

Go to Download

A fluent PHP wrapper for web page content retrieval, screenshots, PDFs, Lighthouse audits, and concurrent site crawling using Chrome.

Go to Download

MNB ScraperKit V1.0.3 - enterprise-ready PHP crawling and data extraction framework with AI crawl intelligence, search discovery, authorized mail/webmail extraction connectors, publisher metadata workflows, extraction recipes, provenance, quality reports, datasets, queues, dashboards, and compliance tooling.

Go to Download

A web scraper for PHP to easily extract data from web pages -> party of laurentvw

Go to Download

A generic rate limiter for the web and reactphp. Useful for API clients, web crawling, or other tasks that need to be throttled

Go to Download

A generic rate limiter for the web and reactphp. Useful for API clients, web crawling, or other tasks that need to be throttled

Go to Download

A powerful WordPress plugin for data migration and web crawling using Rake 2.0 framework

Go to Download

Laravel-Goutte is a laravel service container wrapper for FriendsOfPHP Goutte Package which is a screen scraping and web crawling library for PHP.

Go to Download

A powerful WordPress plugin for data migration and web crawling using Rake 2.0 framework

Go to Download

Effortless recursive web crawling for comprehensive site indexing

Go to Download

A simple spider crawling web pages from baike.baidu.com

Go to Download