Libraries tagged by crawling
xberg-io/crawlberg
16 Downloads
High-performance web crawling engine
shel/crawler
3142 Downloads
Allows crawling of sitemaps and node-trees
blackbird/module-cache-warmer
1883 Downloads
A Magento 2 module that improves store performance by automatically warming cache through intelligent page crawling and async refresh mechanisms.
web-nomads/wn-ai-bridge
53 Downloads
TYPO3 extension for generating llms.txt links based on the llmstxt.org specification and an on-site AI search assistant that helps visitors find information via ke_search and indexed_search.
renoki-co/clusteer
1244 Downloads
Clusteer is a Puppeteer wrapper written for PHP, with the super-power of parallelizing pages across multiple browser instances.
mehrabx/web-crawler
11 Downloads
A web crawler package
laurentvw/scrapher
2537 Downloads
A web scraper for PHP to easily extract data from web pages
essfeed/event-feed
35 Downloads
Create XML ESS Feeds and broadcast events information to Search Engines to improve SEO
dexiio/dexi-api-client
10468 Downloads
Dexi API Client for PHP 5.3+
crwlr/crawler-ext-browser
1733 Downloads
Extension for the crwlr/crawler package containing steps utilizing a headless browser.
68publishers/crawler-client-php
759 Downloads
laurentvw/lavacrawler
97 Downloads
A web scraper for PHP to easily extract data from web pages
stil/curl-robot
22786 Downloads
Parallel URL crawling extension to curl-easy.
slote/spider
8 Downloads
Spider is a php library for crawling website that allows you to scrape informations & automated actions.
mediashare/spider
121 Downloads
Spider is a php library for crawling website that allows you to scrape informations & automated actions.