Libraries tagged by crawlers
cobaia/marsvin
111 Downloads
Marsvin it's a framework to write crawler applications
cable8mm/water-melon
2713 Downloads
Water Melon is simple melon.com api sdk for php
brunodebarros/http-request
205 Downloads
A web crawler, built to be easily dropped into PHP applications, which behaves just like a regular web browser, interpreting location redirects and storing cookies automatically.
vdaguenet/one-page-seo
37 Downloads
Serve static content of a one-page website to crawlers (e.g. Facebook, Google or Twitter) using PhantomJS
laurentvw/lavacrawler
95 Downloads
A web scraper for PHP to easily extract data from web pages
grab/spider
114 Downloads
PHP async scrapper used multi curl and reactphp, and proxy inspired by python grab
gpupo/camelspider
1 Downloads
A class to help handle gateways to processing entities.
danack/sitetool
31 Downloads
Event based site tool and tester.
core23/lastfm-api
2783 Downloads
Last.fm webservice client for php.
appstract/laravel-crawl-render
36 Downloads
Pre-render your site for web crawlers
bringyourownideas/laravel-sitemap
7770 Downloads
A simple website crawler & sitemap generator without a headless browser for Laravel 5.8+
zenstruck/dom
115 Downloads
DOM crawler with advanced selector API and assertions.
yannkuesthardt/laravel-spamprotect
336 Downloads
Encrypt e-mail addresses and phone numbers to protect against unwanted crawlers & spam.
ssola/crawly
13 Downloads
Simple web crawler library
phpscrapers/netflix
17 Downloads
Unofficial API crawler to get Netflix viewing history.