Libraries tagged by scrawl
jyggen/curl
150942 Downloads
A simple and lightweight cURL library with support for asynchronous requests.
gsouf/chromium
527 Downloads
Instrument headless chrome/chromium instances from PHP
zenstruck/dom
12833 Downloads
DOM crawler with advanced selector API and assertions.
schliesser/sitecrawler
39484 Downloads
TYPO3 sitemap crawler
flancer32/mage2_ext_bot_sess
12575 Downloads
Magento2: prevent session creation for bots & crawlers.
cleantalk/anti-ddos-lite
5023 Downloads
A small PHP app to protect your site against DDoS attack or crawling web site by bots.
xcrawler/xcrawler
881 Downloads
A fast, simple and powerful PHP web crawler (scraper/spider) 快速、简洁且强大的爬虫/采集框架
xberg-io/crawlberg
16 Downloads
High-performance web crawling engine
webignition/symfony-panther-dom-crawler-navigator
22128 Downloads
Navigate around a symfony panther dom crawler using convenience methods
tnm/crawler-devbox-sitepackage
9573 Downloads
shel/crawler
3093 Downloads
Allows crawling of sitemaps and node-trees
nadar/crawler
24985 Downloads
A highly extendible, dependency free Crawler for HTML, PDFS or any other type of Documents.
migliori/sitemap-crawler
4095 Downloads
Sitemap crawler/generator. For the given URL it will return sitemap XML file with URLs and images.
lndj/lcrawl
2307 Downloads
一只优雅的正方教务系统爬虫。
lbonnet/crawler-toolkit
590 Downloads
Shared, framework-agnostic building blocks for polite and safe web crawlers: SSRF-aware HTTP throttling, robots.txt parsing, and HTML link discovery.