Libraries tagged by php crawler
mihaeu/tarantula
50 Downloads
Another PHP crawler based on Guzzle.
flowd/phirewall-preset-bots
11 Downloads
Bot and AI-crawler control presets for the Phirewall PHP firewall - block AI scrapers and rate-limit aggressive SEO crawlers
webcrawlerapi/sdk
116 Downloads
A PHP SDK for WebCrawler API - turn website into data
vakata/downloader
799 Downloads
A PHP class for making a static copy (or indexing) a site
utrodus/malaysia-public-holiday
140 Downloads
A PHP library to crawl Malaysia public holidays with filtering and caching.
slote/spider
8 Downloads
Spider is a php library for crawling website that allows you to scrape informations & automated actions.
sleimanx2/grawler
297 Downloads
A guided html crawler with media meta extraction
seotracker/seocore
73 Downloads
seo-core library for php
pagemunch/pagemunch
31 Downloads
A PHP wrapper for the PageMunch link unfurling API
orkan/tlc
26 Downloads
Simple PHP/cURL (T)ransport framework with (L)ogger, (C)ache and more!
monteduro/laravel-datafast-aicrawl
4 Downloads
Server-side AI crawler & bot traffic tracking for Laravel, reporting to DataFast. Unofficial PHP port of @datafast/ai-crawl.
mediashare/spider
121 Downloads
Spider is a php library for crawling website that allows you to scrape informations & automated actions.
laurentvw/scrapher
2537 Downloads
A web scraper for PHP to easily extract data from web pages
itgalaxy/webcrawler-verifier
2992 Downloads
PHP library providing functionality to verify that user-agents are who they claim to be.
fhferreira/sintegra-cnpj-sp-gratis
12 Downloads
Package com Crawler para extração gratuita de dados utilizando CNPJ's diretamente no site do sintegra de sp.