Libraries tagged by zcrawler

Verify Googlebot (or others) by their IP addresses

Go to Download

Extract different parts of an HTML or XML document.

Go to Download

Tiny WebCrawler for Laravel using Playwright

Go to Download

Last.fm webservice client for php.

Go to Download

A tool to crawl your own laravel installation checking your HTTP status codes

Go to Download

Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性

Go to Download

PHP SDK for Firecrawl API - Web scraping and crawling service

Go to Download

A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience

Go to Download

Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web search and testing solution. It can be used for a wide range of purposes, from extracting and indexing structured data to monitoring and automated testing.

Go to Download

A new generation of multi-process async event-driven spider engine based on Workerman

Go to Download

Creates a sitemap.xml by parsing the whole website.

Go to Download

jQuery-inspired DOM manipulation extension for Symfony's Crawler

Go to Download

Encrypt e-mail addresses and phone numbers to protect against unwanted crawlers & spam.

Go to Download

LLMs.txt Generator - Generates llms.txt files for AI/LLM crawlers with website content in Markdown format, with optional API key protection.

Go to Download

PHP Sitemap crawler

Go to Download