Libraries tagged by zcrawler

Go to Download

Generic Scrapy-like web crawler for Laravel — auto-detects lists, pagination, fields, and supports API/SPA, infinite scroll, image downloading, dedup, resumable crawls, and pluggable output sinks.

Go to Download

This bundle provides console command that detects broken links on your website.

Go to Download

Makes data extraction from leboncoin.fr easy

Go to Download

2D crawler for set.or.th

Go to Download

A crawler application written with php and Laravel that finds email addresses on the internets.

Go to Download

A PHP SDK for WebCrawler API - turn website into data

Go to Download

A PHP class for making a static copy (or indexing) a site

Go to Download

A Laravel package that provides a standardized .well-known/traffic-advice endpoint for communicating server load, maintenance windows, and access recommendations to automated clients, crawlers, and partner services.

Go to Download

Package to provide api-like access to foreign sites based on html parsing

Go to Download

Server-side AI crawler tracking middleware for Laravel applications.

Go to Download

Laravel middleware za blokiranje AI crawlera i tražilica. Auto-registracija, konfigurabilan, podržava Laravel 10/11/12/13.

Go to Download

Crawl, match, parse IP or IP range, check if IP or range is in another range. Support IPv4, IPv6, IP Interval, Wildcard and CIDR. Check if IP is Cloudflare node IP, Google bot IP. 爬取，正则匹配，解析 IP 和 IP 范围，检测 IP 或范围是否在另一个范围中。支持 IPv4，IPv6，区间、通配符或 CIDR 表示的 IP 范围。检测 IP 是否是 Cloudflare 节点或 Google 漫游器 IP

Go to Download

Google search results crawler, get google search results that you need.

Go to Download

Sitemap crawler and generator class

Go to Download