Libraries tagged by 64Robots
spatie/laravel-robots-middleware
1681029 Downloads
Add an `all` or `none` robots header to your requests via a middleware in Laravel
vipnytt/sitemapparser
1648406 Downloads
XML Sitemap parser class compliant with the Sitemaps.org protocol.
probots-io/pinecone-php
90687 Downloads
Unofficial PHP Client for Pinecone Vector Database (pinecone.io)
webignition/robots-txt-file
1016396 Downloads
Models a robots.txt file
vipnytt/robotstxtparser
659221 Downloads
Robots.txt parsing library, with full support for every directive and specification.
verschuur/laravel-robotstxt
306829 Downloads
Set the robots.txt content dynamically based on the Laravel app environment.
t1gor/robots-txt-parser
476337 Downloads
PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.
healey/robots
188225 Downloads
Robots.txt Generator for Laravel 4 and 5
bopoda/robots-txt-parser
189817 Downloads
PHP Class for parsing robots.txt files according to Google, Yandex specifications.
novactive/ezseobundle
230222 Downloads
Novactive eZ SEO Bundle is an Ibexa Platform bundle for SEO simplications. metas, sitemaps, robots.txt, etc.
marcortola/behat-seo-contexts
110480 Downloads
Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang, meta robots, robots.txt, redirects, sitemap validation, HTML validation, performance...
monperrus/crawler-user-agents
1799 Downloads
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
tractorcow/silverstripe-robots
82240 Downloads
Simple robots generation module for Silverstripe
tomverran/robots-txt-checker
48423 Downloads
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page
mguinea/laravel-robots
46577 Downloads
Laravel package to manage robots in an easy way