Libraries tagged by web crawling
duzun/hquery
169115 Downloads
An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies. PHP5+
crwlr/crawler
17516 Downloads
Web crawling and scraping library.
crwlr/robots-txt
34556 Downloads
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
web-vision/ai-llms-txt
5458 Downloads
TYPO3 extension for generating .well-known/llm.txt links according to llmstxt.org specification
cleantalk/anti-ddos-lite
4565 Downloads
A small PHP app to protect your site against DDoS attack or crawling web site by bots.
helgesverre/firecrawl-php-sdk
12794 Downloads
PHP SDK for Firecrawl API - Web scraping and crawling service
firecrawl/firecrawl-sdk
1943 Downloads
PHP SDK for the Firecrawl v2 API with Laravel support
crawlzone/crawlzone
5403 Downloads
Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web search and testing solution. It can be used for a wide range of purposes, from extracting and indexing structured data to monitoring and automated testing.
mehrabx/web-crawler
11 Downloads
A web crawler package
proclnas/curl-rox
19 Downloads
Just another curl wrapper for webCrawling purposes
mnb/scraperkit
4 Downloads
MNB ScraperKit V1.0.3 - enterprise-ready PHP crawling and data extraction framework with AI crawl intelligence, search discovery, authorized mail/webmail extraction connectors, publisher metadata workflows, extraction recipes, provenance, quality reports, datasets, queues, dashboards, and compliance tooling.
laurentvw/scrapher
2537 Downloads
A web scraper for PHP to easily extract data from web pages
laurentvw/lavacrawler
97 Downloads
A web scraper for PHP to easily extract data from web pages
matheusfaustino/phrawl
3 Downloads
A web crawling framework in PHP
gavinggordon/sorcerer
18 Downloads
An easy-to-use PHP class for scraping webpages' source code.