Libraries tagged by crawl

vlados/laravel-blade-crawler-detect

0 Favers
5583 Downloads

Boost Lighthouse and PageSpeed scores by hiding cookie banners, chat widgets and heavy scripts from crawlers via two Blade directives. Octane-safe.

shel/crawler

9 Favers
2973 Downloads

Allows crawling of sitemaps and node-trees

migliori/sitemap-crawler

3 Favers
3970 Downloads

Sitemap crawler/generator. For the given URL it will return sitemap XML file with URLs and images.

luyadev/luya-module-crawler

6 Favers
33984 Downloads

An full search page crawler to enable complex and customized searching abilities.

katsana/dusk-crawler

24 Favers
13190 Downloads

Web Crawler using Laravel Dusk

kalmargabor/crawler-check

5 Favers
4540 Downloads

Verify Googlebot (or others) by their IP addresses

dachcom-digital/dynamic-search-data-provider-crawler

7 Favers
31671 Downloads

crawlzone/crawlzone

82 Favers
5411 Downloads

Crawlzone is a fast asynchronous internet crawling framework aiming to provide open source web search and testing solution. It can be used for a wide range of purposes, from extracting and indexing structured data to monitoring and automated testing.

bitandblack/document-crawler

6 Favers
711 Downloads

Extract different parts of an HTML or XML document.

alikdex/yii2-crawler-detect

14 Favers
22791 Downloads

Yii2 extension for CrawlerDetect library

elboletaire/crawler

41 Favers
6728 Downloads

A simple crawler (spider) writen in php just for fun

luka-dev/headless-task-server-php

10 Favers
10426 Downloads

Helper for sending requests to luka-dev/headless-task-server

jpcaparas/laravel-firecrawl

8 Favers
1561 Downloads

Interface with the Firecrawl API using Laravel

infostars/headless-chromium-php

3 Favers
10652 Downloads

Instrument headless chrome/chromium instances from php5.6

gsouf/chromium

2668 Favers
525 Downloads

Instrument headless chrome/chromium instances from PHP

<< Previous Next >>