Libraries tagged by cradle
bringyourownideas/laravel-sitemap
7866 Downloads
A simple website crawler & sitemap generator without a headless browser for Laravel 5.8+
blogdaren/webman-phpcreeper
306 Downloads
PHPCreeper plugin for webman
bitandblack/sitemap
3498 Downloads
Creates a sitemap.xml by parsing the whole website.
godbout/htmlpagedom
26891 Downloads
jQuery-inspired DOM manipulation extension for Symfony's Crawler
crossjoin/browscap
234370 Downloads
The standalone PHP Browscap parser Crossjoin\Browscap detects browser properties as well as device information based on the user agent string of the requesting browsers and search engines, using the data from the Browser Capabilities Project. It's several hundred times faster than the build-in PHP function get_browser(), and faster than other Browscap PHP libraries, with much lower memory consumption. Optionally Crossjoin\Browscap automatically updates the Browscap data, so you're always up-to-date. The newest version is build for PHP 7.x, for PHP >= 5.6 use version 2.x, for PHP >= 5.3 use version 1.x.
cravler/dnode
28122 Downloads
DNode RPC protocol for PHP 5.3
cradeq/commonmark-html-whitelist-extension
514 Downloads
Allows HTML tags to be used in Markdown, while still escaping or stripping all other HTML input.
yannkuesthardt/laravel-spamprotect
520 Downloads
Encrypt e-mail addresses and phone numbers to protect against unwanted crawlers & spam.
silverstripe-labs/googleanalytics
10115 Downloads
The Google Analytics module consists of 2 components that can be employed independently: The Google Logger injects the google analytics javascript snippet into your source code and logs relevant events (as of now only crawler visits) The Analyzer adds the Google Analytics UI to your CMS.
orangecat/checkip
142 Downloads
Prevent crawlers and IPs reported from creating a session
neclimdul/coveo-push-api
985 Downloads
The Push API allows you to *push* items and security identities, as opposed to letting standard Coveo Cloud V2 crawlers *pull* this data from a content repository. This is especially useful when you need to index content from a cloud or on-premises system for which no dedicated source type exists in the Coveo Cloud V2 platform.
mjp91/sitemap-generator
16976 Downloads
Generates an XML site map for use by web crawlers
mauricerenck/darkvisitors
265 Downloads
Kirby robots.txt plugin for blocking AI Crawlers and Bots
kiwa/link-obfuscator
5475 Downloads
Strong link obfuscation with PHP and JavaScript. Object-oriented, using the Rot47 algorithm. Hides https, email, phone and sms links from being crawled by spambots.
giordanolima/fipe
273 Downloads
Web Crawler para consultar valores atuais e de meses passados da tabela Fipe.