Libraries tagged by php crawler

The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as device information based on the user agent string of the requesting browsers and search engines, using the data from the Browser Capabilities Project. It's several hundred times faster than the build-in PHP function get_browser(), and faster than other Browscap PHP libraries, with much lower memory consumption. Optionally Crossjoin\Browscap automatically updates the Browscap data, so you're always up-to-date. The newest version is build for PHP 7.x, for PHP >= 5.6 use version 2.x, for PHP >= 5.3 use version 1.x.

Go to Download

A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架

Go to Download

PHP Sitemap crawler

Go to Download

A crawler application written with php and Laravel that finds email addresses on the internets.

Go to Download

A simple crawler (spider) writen in php just for fun

Go to Download

Lightweight proxy with full support for sessions, cookies, POST/FORM submissions, and URL rewriting.

Go to Download

An full search page crawler to enable complex and customized searching abilities.

Go to Download

Standalone Laravel package for queued Flickr crawling with rate limiting and MySQL persistence.

Go to Download

Google search results crawler, get google search results that you need.

Go to Download

A PHP SDK for WebCrawler API - turn website into data

Go to Download

Symfony Spider Bundle

Go to Download

Crawler + Scraper + Parser library

Go to Download

PHP POO cURL wrapper (PSR friendly) : light and simple.

Go to Download

A professional, production-ready PHP XML sitemap generator with advanced features: concurrency, robots.txt, caching, database storage, change detection, SEO analysis, JavaScript rendering, proxy support, webhooks, and more.

Go to Download

Lightweight web crawler for php

Go to Download