Libraries tagged by scrawl
migliori/sitemap-crawler
4243 Downloads
Sitemap crawler/generator. For the given URL it will return sitemap XML file with URLs and images.
katsana/dusk-crawler
13344 Downloads
Web Crawler using Laravel Dusk
kalmargabor/crawler-check
4869 Downloads
Verify Googlebot (or others) by their IP addresses
dachcom-digital/dynamic-search-data-provider-crawler
32309 Downloads
bitandblack/document-crawler
1040 Downloads
Extract titles, meta tags, images, anchors, headings, canonical URLs, structured data and more from HTML or XML documents, based on Symfony's DomCrawler.
alikdex/yii2-crawler-detect
23093 Downloads
Yii2 extension for CrawlerDetect library
cviniciussdias/google-crawler
156 Downloads
A simple Crawler for getting Google results
zrashwani/arachnid
20420 Downloads
A crawler to find all unique internal pages on a given website
zfr/zfr-prerender
8538 Downloads
Integration with prerender.io service
tomatophp/filament-translations-google
3460 Downloads
Translations Manager extension to use Google translation crawling to auto translate your __(), trans() fn
szczyglis/php-ultra-small-proxy
339 Downloads
Lightweight proxy with full support for sessions, cookies, POST/FORM submissions, and URL rewriting.
sorge-it/phpunit-pest-html-assertions
615 Downloads
HTML assertions for PHPUnit and Pest: check rendered HTML with CSS selectors, never as a string. With PHPStan rules, a Rector rule and a skill for AI coding agents.
slimad/indexnow
765 Downloads
Framework-agnostic IndexNow client and queue for submitting URL changes to participating search engines (Bing, Yandex, Seznam, Naver, Yep).
sleeping-owl/apist
5323 Downloads
Package to provide api-like access to foreign sites based on html parsing
ropendev/curl
7059 Downloads
PHP POO cURL wrapper (PSR friendly) : light and simple.