PHP code example of umpirsky / centipede-crawler
1. Go to this page and download the library: Download umpirsky/centipede-crawler library. Choose the download type require. 2. Extract the ZIP file and open the index.php. 3. Add this code to the index.php.
<?php
require_once('vendor/autoload.php');
/* Start to develop here. Best regards https://php-download.com/ */
umpirsky / centipede-crawler example snippets
$urls = (new Centipede\Crawler('http://dev.umpirsky.com'))->crawl();
(new Centipede\Crawler('http://dev.umpirsky.com'))->crawl(function ($url, GuzzleHttp\Message\FutureResponse $response) {
printf('(%d) %s', $response->getStatusCode(), $url);
});