Libraries tagged by scrawl

migliori/sitemap-crawler

3 Favers
4243 Downloads

Sitemap crawler/generator. For the given URL it will return sitemap XML file with URLs and images.

Go to Download


katsana/dusk-crawler

24 Favers
13344 Downloads

Web Crawler using Laravel Dusk

Go to Download


kalmargabor/crawler-check

5 Favers
4869 Downloads

Verify Googlebot (or others) by their IP addresses

Go to Download


dachcom-digital/dynamic-search-data-provider-crawler

7 Favers
32309 Downloads

Go to Download


bitandblack/document-crawler

7 Favers
1040 Downloads

Extract titles, meta tags, images, anchors, headings, canonical URLs, structured data and more from HTML or XML documents, based on Symfony's DomCrawler.

Go to Download


alikdex/yii2-crawler-detect

14 Favers
23093 Downloads

Yii2 extension for CrawlerDetect library

Go to Download


cviniciussdias/google-crawler

20 Favers
156 Downloads

A simple Crawler for getting Google results

Go to Download


zrashwani/arachnid

255 Favers
20420 Downloads

A crawler to find all unique internal pages on a given website

Go to Download


zfr/zfr-prerender

21 Favers
8538 Downloads

Integration with prerender.io service

Go to Download


tomatophp/filament-translations-google

6 Favers
3460 Downloads

Translations Manager extension to use Google translation crawling to auto translate your __(), trans() fn

Go to Download


szczyglis/php-ultra-small-proxy

20 Favers
339 Downloads

Lightweight proxy with full support for sessions, cookies, POST/FORM submissions, and URL rewriting.

Go to Download


sorge-it/phpunit-pest-html-assertions

0 Favers
615 Downloads

HTML assertions for PHPUnit and Pest: check rendered HTML with CSS selectors, never as a string. With PHPStan rules, a Rector rule and a skill for AI coding agents.

Go to Download


slimad/indexnow

0 Favers
765 Downloads

Framework-agnostic IndexNow client and queue for submitting URL changes to participating search engines (Bing, Yandex, Seznam, Naver, Yep).

Go to Download


sleeping-owl/apist

312 Favers
5323 Downloads

Package to provide api-like access to foreign sites based on html parsing

Go to Download


ropendev/curl

3 Favers
7059 Downloads

PHP POO cURL wrapper (PSR friendly) : light and simple.

Go to Download


<< Previous Next >>