Libraries tagged by web crawling
duzun/hquery
191440 Downloads
An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies. PHP5+
crwlr/crawler
19032 Downloads
Web crawling and scraping library.
helgesverre/firecrawl-php-sdk
14709 Downloads
PHP SDK for Firecrawl API - Web scraping and crawling service
web-vision/ai-llms-txt
8152 Downloads
TYPO3 extension for generating .well-known/llm.txt links according to llmstxt.org specification
firecrawl/firecrawl-sdk
5981 Downloads
PHP SDK for the Firecrawl v2 API with Laravel support
crwlr/robots-txt
37755 Downloads
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
cleantalk/anti-ddos-lite
4948 Downloads
A small PHP app to protect your site against DDoS attack or crawling web site by bots.
crawlzone/crawlzone
5411 Downloads
Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web search and testing solution. It can be used for a wide range of purposes, from extracting and indexing structured data to monitoring and automated testing.
xberg-io/crawlberg
1 Downloads
High-performance web crawling engine
mehrabx/web-crawler
11 Downloads
A web crawler package
proclnas/curl-rox
19 Downloads
Just another curl wrapper for webCrawling purposes
web-nomads/wn-ai-bridge
23 Downloads
TYPO3 extension for generating llms.txt links based on the llmstxt.org specification and an on-site AI search assistant that helps visitors find information via ke_search and indexed_search.
laurentvw/scrapher
2537 Downloads
A web scraper for PHP to easily extract data from web pages
laurentvw/lavacrawler
97 Downloads
A web scraper for PHP to easily extract data from web pages
matheusfaustino/phrawl
3 Downloads
A web crawling framework in PHP