Libraries tagged by cradle

Modern library to handle RSS/Atom feeds

Go to Download

build mirror of packagist.org

Go to Download

Crawl all internal links found on a website

Go to Download

Makes data extraction from leboncoin.fr easy

Go to Download

A crawler application written with php and Laravel that finds email addresses on the internets.

Go to Download

A simple crawler (spider) writen in php just for fun

Go to Download

A Laravel package that provides a standardized .well-known/traffic-advice endpoint for communicating server load, maintenance windows, and access recommendations to automated clients, crawlers, and partner services.

Go to Download

Lightweight proxy with full support for sessions, cookies, POST/FORM submissions, and URL rewriting.

Go to Download

Symfony Spider Bundle

Go to Download

Crawler + Scraper + Parser library

Go to Download

Crawl, match, parse IP or IP range, check if IP or range is in another range. Support IPv4, IPv6, IP Interval, Wildcard and CIDR. Check if IP is Cloudflare node IP, Google bot IP. 爬取，正则匹配，解析 IP 和 IP 范围，检测 IP 或范围是否在另一个范围中。支持 IPv4，IPv6，区间、通配符或 CIDR 表示的 IP 范围。检测 IP 是否是 Cloudflare 节点或 Google 漫游器 IP

Go to Download

A web scraper for PHP to easily extract data from web pages

Go to Download

PHP library providing functionality to verify that user-agents are who they claim to be.

Go to Download

Sitemap crawler and generator class

Go to Download

A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience

Go to Download