Libraries tagged by CrawlLib
backtend/phplib
60 Downloads
Several commonly used php libraries
duzun/hquery
164438 Downloads
An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies. PHP5+
crwlr/crawler
17088 Downloads
Web crawling and scraping library.
crawlbase/crawlbase
58842 Downloads
A lightweight, dependency free PHP class that acts as wrapper for Crawlbase API
proxycrawl/proxycrawl
104349 Downloads
A lightweight, dependency free PHP class that acts as wrapper for ProxyCrawl API
stil/curl-easy
211201 Downloads
cURL wrapper for PHP. Supports parallel and non-blocking requests. For high speed crawling, see stil/curl-robot.
crwlr/robots-txt
33845 Downloads
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
web-vision/ai-llms-txt
4898 Downloads
TYPO3 extension for generating .well-known/llm.txt links according to llmstxt.org specification
kreuzberg-dev/kreuzcrawl
30 Downloads
High-performance web crawling engine
cleantalk/anti-ddos-lite
4506 Downloads
A small PHP app to protect your site against DDoS attack or crawling web site by bots.
zfr/zfr-prerender
8239 Downloads
Integration with prerender.io service
tomatophp/filament-translations-google
2576 Downloads
Translations Manager extension to use Google translation crawling to auto translate your __(), trans() fn
plasticstudio/silverstripe-seo
8456 Downloads
A SilverStripe module to optimise the Meta, crawling, indexing, and sharing of your website content (forked from Cyber-Duck/Silverstripe-SEO)
firecrawl/firecrawl-sdk
1462 Downloads
PHP SDK for the Firecrawl v2 API with Laravel support
cyber-duck/silverstripe-seo
51324 Downloads
A SilverStripe module to optimise the Meta, crawling, indexing, and sharing of your website content