Libraries tagged by web crawling

duzun/hquery

362 Favers
169115 Downloads

An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies. PHP5+

Go to Download


crwlr/crawler

372 Favers
17516 Downloads

Web crawling and scraping library.

Go to Download


crwlr/robots-txt

11 Favers
34556 Downloads

Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping

Go to Download


web-vision/ai-llms-txt

3 Favers
5458 Downloads

TYPO3 extension for generating .well-known/llm.txt links according to llmstxt.org specification

Go to Download


cleantalk/anti-ddos-lite

124 Favers
4565 Downloads

A small PHP app to protect your site against DDoS attack or crawling web site by bots.

Go to Download


helgesverre/firecrawl-php-sdk

4 Favers
12794 Downloads

PHP SDK for Firecrawl API - Web scraping and crawling service

Go to Download


firecrawl/firecrawl-sdk

1 Favers
1943 Downloads

PHP SDK for the Firecrawl v2 API with Laravel support

Go to Download


crawlzone/crawlzone

82 Favers
5403 Downloads

Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web search and testing solution. It can be used for a wide range of purposes, from extracting and indexing structured data to monitoring and automated testing.

Go to Download


mehrabx/web-crawler

4 Favers
11 Downloads

A web crawler package

Go to Download


proclnas/curl-rox

10 Favers
19 Downloads

Just another curl wrapper for webCrawling purposes

Go to Download


mnb/scraperkit

0 Favers
4 Downloads

MNB ScraperKit V1.0.3 - enterprise-ready PHP crawling and data extraction framework with AI crawl intelligence, search discovery, authorized mail/webmail extraction connectors, publisher metadata workflows, extraction recipes, provenance, quality reports, datasets, queues, dashboards, and compliance tooling.

Go to Download


laurentvw/scrapher

20 Favers
2537 Downloads

A web scraper for PHP to easily extract data from web pages

Go to Download


laurentvw/lavacrawler

18 Favers
97 Downloads

A web scraper for PHP to easily extract data from web pages

Go to Download


matheusfaustino/phrawl

0 Favers
3 Downloads

A web crawling framework in PHP

Go to Download


gavinggordon/sorcerer

1 Favers
18 Downloads

An easy-to-use PHP class for scraping webpages' source code.

Go to Download


Next >>