Libraries tagged by scrawl

Extract titles, meta tags, images, anchors, headings, canonical URLs, structured data and more from HTML or XML documents, based on Symfony's DomCrawler.

Go to Download

A simple Crawler for getting Google results

Go to Download

A crawler to find all unique internal pages on a given website

Go to Download

Integration with prerender.io service

Go to Download

Translations Manager extension to use Google translation crawling to auto translate your __(), trans() fn

Go to Download

HTML assertions for PHPUnit and Pest: check rendered HTML with CSS selectors, never as a string. With PHPStan rules, a Rector rule and a skill for AI coding agents.

Go to Download

Framework-agnostic IndexNow client and queue for submitting URL changes to participating search engines (Bing, Yandex, Seznam, Naver, Yep).

Go to Download

Tiny WebCrawler for Laravel using Playwright

Go to Download

Clusteer is a Puppeteer wrapper written for PHP, with the super-power of parallelizing pages across multiple browser instances.

Go to Download

A SilverStripe module to optimise the Meta, crawling, indexing, and sharing of your website content (forked from Cyber-Duck/Silverstripe-SEO)

Go to Download

A tool to crawl your own laravel installation checking your HTTP status codes

Go to Download

Integrates the Bit&Black Sitemap into a Kiwa website to create sitemap files seamlessly.

Go to Download

Interface with the Firecrawl API using Laravel

Go to Download

Protect your Laravel app from AI scrapers, LLM crawlers, and prompt injection attacks

Go to Download

A professional, production-ready PHP XML sitemap generator with advanced features: concurrency, robots.txt, caching, database storage, change detection, SEO analysis, JavaScript rendering, proxy support, webhooks, and more.

Go to Download