Libraries tagged by zcrawler

Laravel package for smking AEO — auto-inject JSON-LD, FAQ, and AI summary into Laravel responses so AI crawlers (ChatGPT, Perplexity, Google AI) can cite your pages.

Go to Download

Yet another DOM crawler, inspired by symfony/dom-crawler

Go to Download

Open-core SEO infrastructure for Laravel: metadata, canonical URLs, social cards, linked JSON-LD, XML sitemaps and crawler controls - the free MIT core.

Go to Download

Generates an XML site map for use by web crawlers

Go to Download

Serve Markdown versions of your Craft CMS pages to AI crawlers and LLMs via .md URLs, content negotiation, and user-agent detection.

Go to Download

Ban AI crawlers from visiting your Symfony website or application

Go to Download

Lib para converter HTML em PDF de uma maneira segura para as necessidades dos crawlers.

Go to Download

Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫)，基于phpQuery。

Go to Download

Lightweight web crawler for php

Go to Download

宇润爬虫框架(Yurun Crawler) 是一个低代码、高性能、分布式爬虫采集框架，这可能是最一把梭的爬虫框架。

Go to Download

A versatile and extendable crawler for TYPO3 CMS

Go to Download

Go to Download

Boost Lighthouse and PageSpeed scores by hiding cookie banners, chat widgets and heavy scripts from crawlers via two Blade directives. Octane-safe.

Go to Download

Link crawler robot — Composer/Packagist mirror of the Moodle plugin tool_crawler, auto-updated from the Moodle plugins directory.

Go to Download

Web crawler based on PHP Guzzle HTTP Client with concurrency support for faster operation.

Go to Download