Libraries tagged by web crawler
mehrabx/web-crawler
11 Downloads
A web crawler package
mcstreetguy/crawler
7 Downloads
An advanced web-crawler written in PHP.
macsch15/crawler-detector
1778 Downloads
Fat-free, standalone and fast web crawler (bot) detector
itgalaxy/webcrawler-verifier
2992 Downloads
PHP library providing functionality to verify that user-agents are who they claim to be.
baraja-core/webcrawler
34 Downloads
Simple package to load list of urls and make sitemap.
blanchonvincent/simple-page-crawler
191 Downloads
ZF2 module v0.3.0 - Provide a crawler to get web page informations : title, meta, heading tags and images
vlados/laravel-blade-crawler-detect
5130 Downloads
Boost Lighthouse and PageSpeed scores by hiding cookie banners, chat widgets and heavy scripts from crawlers via two Blade directives. Octane-safe.
brunodebarros/http-request
207 Downloads
A web crawler, built to be easily dropped into PHP applications, which behaves just like a regular web browser, interpreting location redirects and storing cookies automatically.
appstract/laravel-crawl-render
37 Downloads
Pre-render your site for web crawlers
webcrawlerapi/sdk
116 Downloads
A PHP SDK for WebCrawler API - turn website into data
webscraping-ai/webscraping-ai-php
3 Downloads
Official PHP client for the WebScraping.AI API — LLM-powered web scraping with rotating proxies and Chromium JavaScript rendering.
pagemunch/pagemunch
31 Downloads
A PHP wrapper for the PageMunch link unfurling API
laurentvw/scrapher
2537 Downloads
A web scraper for PHP to easily extract data from web pages
laurentvw/lavacrawler
97 Downloads
A web scraper for PHP to easily extract data from web pages
ssola/crawly
18 Downloads
Simple web crawler library