Libraries tagged by cradle
rfussien/leboncoin-crawler
358 Downloads
Makes data extraction from leboncoin.fr easy
elboletaire/crawler
6702 Downloads
A simple crawler (spider) writen in php just for fun
szczyglis/php-ultra-small-proxy
90 Downloads
Lightweight proxy with full support for sessions, cookies, POST/FORM submissions, and URL rewriting.
nucleos/lastfm
11177 Downloads
Last.fm webservice client for php.
mantoufan/yzhanip
1232 Downloads
Crawl, match, parse IP or IP range, check if IP or range is in another range. Support IPv4, IPv6, IP Interval, Wildcard and CIDR. Check if IP is Cloudflare node IP, Google bot IP. 爬取,正则匹配,解析 IP 和 IP 范围,检测 IP 或范围是否在另一个范围中。支持 IPv4,IPv6,区间、通配符或 CIDR 表示的 IP 范围。检测 IP 是否是 Cloudflare 节点或 Google 漫游器 IP
kiwa/sitemap
3614 Downloads
Integrates the Bit&Black Sitemap into a Kiwa website to create sitemap files seamlessly.
itgalaxy/webcrawler-verifier
2813 Downloads
PHP library providing functionality to verify that user-agents are who they claim to be.
haikson/sitemap-generator
0 Downloads
Sitemap crawler and generator class
blogdaren/webman-phpcreeper
239 Downloads
PHPCreeper plugin for webman
bitandblack/sitemap
2398 Downloads
Creates a sitemap.xml by parsing the whole website.
51degrees/fiftyone.devicedetection
8413 Downloads
Device detection engines for 51Degrees Pipeline API. Parse HTTP headers to detect hardware, operating system, browser, and crawler information.
crossjoin/browscap
234335 Downloads
The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as device information based on the user agent string of the requesting browsers and search engines, using the data from the Browser Capabilities Project. It's several hundred times faster than the build-in PHP function get_browser(), and faster than other Browscap PHP libraries, with much lower memory consumption. Optionally Crossjoin\Browscap automatically updates the Browscap data, so you're always up-to-date. The newest version is build for PHP 7.x, for PHP >= 5.6 use version 2.x, for PHP >= 5.3 use version 1.x.
cravler/dnode
27135 Downloads
DNode RPC protocol for PHP 5.3
zrashwani/arachnid
20195 Downloads
A crawler to find all unique internal pages on a given website
silverstripe-labs/googleanalytics
10016 Downloads
The Google Analytics module consists of 2 components that can be employed independently: The Google Logger injects the google analytics javascript snippet into your source code and logs relevant events (as of now only crawler visits) The Analyzer adds the Google Analytics UI to your CMS.