Libraries tagged by crawler

A PHP desktop/mobile user agent parser with bot detection, based on Mobiledetect and CrawlerDetect.

Go to Download

parser/handler for Robots Exclusion Protocol (robots.txt and more)

Go to Download

Marsvin it's a framework to write crawler applications

Go to Download

Water Melon is simple melon.com api sdk for php

Go to Download

A web crawler, built to be easily dropped into PHP applications, which behaves just like a regular web browser, interpreting location redirects and storing cookies automatically.

Go to Download

Official, experimental (AI-generated and AI-maintained) Apify API client for PHP: run Actors, manage storages (datasets, key-value stores, request queues), schedules, webhooks and more.

Go to Download

Motor de web scraping com estratégia leve (Guzzle + DomCrawler) ou pesada (Panther/Chrome headless) e adaptadores para sites de empresas em Angola.

Go to Download

Community fork of roach-php/laravel with Laravel 10–13 compatibility, powered by optimized lazy-core

Go to Download

Community fork of roach-php/core with on-demand lazy DOM loading and native JSON response parsing

Go to Download

Serve static content of a one-page website to crawlers (e.g. Facebook, Google or Twitter) using PhantomJS

Go to Download

Detect robots and crawlers.

Go to Download

A web scraper for PHP to easily extract data from web pages

Go to Download

PHP async scrapper used multi curl and reactphp, and proxy inspired by python grab

Go to Download

A class to help handle gateways to processing entities.

Go to Download

Event based site tool and tester.

Go to Download