PHP code example of nickmoline / robots-checker
1. Go to this page and download the library: Download nickmoline/robots-checker library. Choose the download type require. 2. Extract the ZIP file and open the index.php. 3. Add this code to the index.php.
<?php
require_once('vendor/autoload.php');
/* Start to develop here. Best regards https://php-download.com/ */
nickmoline / robots-checker example snippets
e NickMoline\Robots\Header as RobotsHeader;
test.html");
$allowed = $checker->verify(); // By default it checks Googlebot
$allowed = $checker->setUserAgent("bingbot")->verify(); // Checks to see if blocked for bingbot by robots.txt file
echo $checker->getReason(); // Get the reason the url is allowed or denied
$checker2 = new RobotsHeader("http://www.example.com/test.html");
$allowed = $checker->verify(); // Same as above but will test the X-Robots-Tag HTTP headers
$checkerAll = new RobotsAll("http://www.example.com/test.html");
$allowed = $checker->verify(); // This one runs all of the available tests