Libraries tagged by zcrawler

Generates an XML site map for use by web crawlers

Go to Download

Bot traffic hardening and spam protection for Laravel + Livewire: exception noise suppression, honeypot, reCAPTCHA, crawler rules and monitoring.

Go to Download

Scrawler is an extensible, declarative web robot and scrapper

Go to Download

scrawler framework main app container

Go to Download

Report bot and AI-crawler detections to WebDecoy from any PHP application

Go to Download

Know which bots actually hit your site. Counts crawler visits into a JSON file with a lifetime total and rolling 7- and 30-day windows, so you see at a glance whether a bot is new, gone, or ramping up. No database, no dependencies, PHP 5.6+.

Go to Download

Official PHP client for the ScrapeUnblocker web scraping API - JS-rendered pages that bypass Cloudflare, DataDome, PerimeterX and Akamai, plus Google SERP and Skyscanner flights/hotels/car-hire scraping as JSON.

Go to Download

composer repository (aka `packages.json`) model builder component

Go to Download

A Symfony bundle to crawl a site and audit technical SEO signals: canonical tags, indexing directives and redirects.

Go to Download

A Symfony bundle to crawl a site and audit on-page SEO signals (titles, meta descriptions, headings, image alt attributes).

Go to Download

A Symfony bundle to crawl a site and detect broken internal and external links.

Go to Download

Instant indexing and GEO for Craft CMS — push URLs to Google's Indexing API and IndexNow the moment they change, then manage, log and audit how AI search engines read your site.

Go to Download

Motor de web scraping com estratégia leve (Guzzle + DomCrawler) ou pesada (Panther/Chrome headless) e adaptadores para sites de empresas em Angola.

Go to Download

Community fork of roach-php/laravel with Laravel 10–13 compatibility, powered by optimized lazy-core

Go to Download

Community fork of roach-php/core with on-demand lazy DOM loading and native JSON response parsing

Go to Download