1. Go to this page and download the library: Download cybercog/robots-txt library. Choose the download type require.
2. Extract the ZIP file and open the index.php.
3. Add this code to the index.php.
<?php
require_once('vendor/autoload.php');
/* Start to develop here. Best regards https://php-download.com/ */
Route::get('robots.txt', function() {
// If on the live server, serve a nice, welcoming robots.txt.
if (App::environment() == 'production')
{
RobotsTxt::addUserAgent('*');
RobotsTxt::addSitemap('sitemap.xml');
} else {
// If you're on any other server, tell everyone to go away.
RobotsTxt::addDisallow('*');
}
return Response::make(RobotsTxt::generate(), 200, array('Content-Type' => 'text/plain'));
});
use Cog\RobotsTxt\RobotsTxt;
$robotsTxt = new RobotsTxt();
$robotsTxt->addUserAgent('*');
$robotsTxt->addSitemap('sitemap.xml');
header("HTTP/1.1 200 OK");
echo $robotsTxt->generate();
Loading please wait ...
Before you can download the PHP files, the dependencies should be resolved. This can take some minutes. Please be patient.