Libraries tagged by zcrawler

Crawler + Scraper + Parser library

Go to Download

Package to provide api-like access to foreign sites based on html parsing

Go to Download

PHP POO cURL wrapper (PSR friendly) : light and simple.

Go to Download

Crawl, match, parse IP or IP range, check if IP or range is in another range. Support IPv4, IPv6, IP Interval, Wildcard and CIDR. Check if IP is Cloudflare node IP, Google bot IP. 爬取，正则匹配，解析 IP 和 IP 范围，检测 IP 或范围是否在另一个范围中。支持 IPv4，IPv6，区间、通配符或 CIDR 表示的 IP 范围。检测 IP 是否是 Cloudflare 节点或 Google 漫游器 IP

Go to Download

Integrates the Bit&Black Sitemap into a Kiwa website to create sitemap files seamlessly.

Go to Download

A professional, production-ready PHP XML sitemap generator with advanced features: concurrency, robots.txt, caching, database storage, change detection, SEO analysis, JavaScript rendering, proxy support, webhooks, and more.

Go to Download

Google search results crawler, get google search results that you need.

Go to Download

Sitemap crawler and generator class

Go to Download

Package to provide api-like access to foreign sites based on html parsing (fork of sleeping-owl/apist package with updated dependencies)

Go to Download

A Laravel package to fetch webpage metadata ( Open Graph | Twitter | Facebook | Article ) ect...

Go to Download

A simple website crawler & sitemap generator without a headless browser for Laravel 5.8+

Go to Download

High-performance device detection engines for the 51Degrees Pipeline API. Accurately identify devices, operating systems, browsers, and crawlers from HTTP headers.

Go to Download

The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as device information based on the user agent string of the requesting browsers and search engines, using the data from the Browser Capabilities Project. It's several hundred times faster than the build-in PHP function get_browser(), and faster than other Browscap PHP libraries, with much lower memory consumption. Optionally Crossjoin\Browscap automatically updates the Browscap data, so you're always up-to-date. The newest version is build for PHP 7.x, for PHP >= 5.6 use version 2.x, for PHP >= 5.3 use version 1.x.

Go to Download

Last.fm webservice client for php.

Go to Download

An Fully Automatic RESTful PHP Router.

Go to Download