Libraries tagged by zcrawler

phantazm/robotdetector

6 Favers
1872 Downloads

Detect robots and crawlers.

laurentvw/lavacrawler

18 Favers
97 Downloads

A web scraper for PHP to easily extract data from web pages

grab/spider

12 Favers
118 Downloads

PHP async scrapper used multi curl and reactphp, and proxy inspired by python grab

gpupo/camelspider

11 Favers
1 Downloads

A class to help handle gateways to processing entities.

danack/sitetool

5 Favers
33 Downloads

Event based site tool and tester.

appstract/laravel-crawl-render

11 Favers
37 Downloads

Pre-render your site for web crawlers

scrawler/app

4 Favers
150 Downloads

scrawler framework main app container

scrawler/framework

4 Favers
219 Downloads

RAD and Modular PHP Framework

zeix/craft-marked-down

4 Favers
15 Downloads

Marked Down serves Markdown to AI crawlers, command-line tools, and APIs while browsers get HTML. Zero-config per-section setup, automatic AI bot detection, .md URL suffix, /llms.txt, YAML front matter, and dedicated Markdown templates — out of the box.

ssola/crawly

4 Favers
18 Downloads

Simple web crawler library

s25/dom-trawler

0 Favers
7968 Downloads

Yet another DOM crawler, inspired by symfony/dom-crawler

phpscrapers/netflix

6 Favers
19 Downloads

Unofficial API crawler to get Netflix viewing history.

orangecat/feed

4 Favers
3 Downloads

Generate product feed for AI Crawlers

offdev/gpp

6 Favers
8 Downloads

A wrapper around guzzle that provides middleware functionality for responses, URL enumeration capabilities, and a crawler to make use of it

lenonleite/hacking-analyze-static-files

4 Favers
312 Downloads

AsZone Component - Crawler Static File

<< Previous Next >>