Libraries tagged by cradle
helgesverre/firecrawl-php-sdk
14601 Downloads
PHP SDK for Firecrawl API - Web scraping and crawling service
fkrzski/robots-txt
2684 Downloads
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
eddieace/php-simple
65831 Downloads
crwlr/robots-txt
37640 Downloads
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
spatie/laravel-link-checker
53388 Downloads
Check all links in a Laravel app
jyggen/curl
150604 Downloads
A simple and lightweight cURL library with support for asynchronous requests.
zrashwani/arachnid
20413 Downloads
A crawler to find all unique internal pages on a given website
zenstruck/dom
12142 Downloads
DOM crawler with advanced selector API and assertions.
schliesser/sitecrawler
38420 Downloads
TYPO3 sitemap crawler
webignition/symfony-panther-dom-crawler-navigator
21581 Downloads
Navigate around a symfony panther dom crawler using convenience methods
vlados/laravel-blade-crawler-detect
5571 Downloads
Boost Lighthouse and PageSpeed scores by hiding cookie banners, chat widgets and heavy scripts from crawlers via two Blade directives. Octane-safe.
shel/crawler
2972 Downloads
Allows crawling of sitemaps and node-trees
ollywarren/laravel-go-cardless
9677 Downloads
A Laravel Wrapper for the Go Cardless PHP Client Library
migliori/sitemap-crawler
3960 Downloads
Sitemap crawler/generator. For the given URL it will return sitemap XML file with URLs and images.
luyadev/luya-module-crawler
33984 Downloads
An full search page crawler to enable complex and customized searching abilities.