Libraries tagged by web scraper

Generic Scrapy-like web crawler for Laravel — auto-detects lists, pagination, fields, and supports API/SPA, infinite scroll, image downloading, dedup, resumable crawls, and pluggable output sinks.

Go to Download

Readability / Html Content / Article Extractor & Web Scrapping library written in PHP

Go to Download

Simple, elegant, extensible PHP Web Scraper (crawler/spider),Use the css3 dom selector,Based on phpQuery! 简洁、优雅、可扩展的PHP采集工具(爬虫)，基于phpQuery。

Go to Download

Headless manager for the well-known files every modern web app owes bots AND agents — robots.txt, .well-known/security.txt, llms.txt, humans.txt, sitemap.xml, and an agents/AI manifest. Define them once in code/config and serve them consistently. Zero runtime deps; ships a default-open robots evaluator so scrapers can honor robots honestly, and makes it hard to leak a protected path. Framework-agnostic core + Laravel adapter.

Go to Download

A PHP application which runs on Heroku and dumps web site outputs including JavaScript generated contents.

Go to Download

A PHP Web Scraper - Designed for Speed

Go to Download

web-sraping component, inspired by Perl’s Web::Scraper. It provides a DSL-ish interface for traversing HTML documents and returning a neatly arranged PHP ‘s multidimensional array

Go to Download

Scraper is a multi-threaded CURL wrapper for Laravel 5 that is a highly efficient web scraper.

Go to Download

A Laravel package for the Decodo Web Scraping API — real-time, async, webhooks, DB tracking, caching, and testing helpers

Go to Download

A web crawler package

Go to Download

Service to scrape a web page easily without knowing their HTML structure.

Go to Download

Unofficial MyAnimeList API that scrap and parse everything from MyAnimeList web into array and json

Go to Download

Open source excel or libreoffice and PHP SEO google position SERP checker to track and follow a few website's keywords positions

Go to Download

Web Scraping para extraer facturas electronicas masivamente desde la pagina del SAT

Go to Download

现代化的 PHP 工具包，包含强大的 DOM 操作库、数据转换和一些常用的类库、HTTP网络请求、代码压缩、通用函数集和实用工具等

Go to Download