Libraries tagged by 64Robots

spatie/laravel-robots-middleware

334 Favers
1681029 Downloads

Add an `all` or `none` robots header to your requests via a middleware in Laravel

Go to Download


vipnytt/sitemapparser

80 Favers
1648406 Downloads

XML Sitemap parser class compliant with the Sitemaps.org protocol.

Go to Download


probots-io/pinecone-php

63 Favers
90687 Downloads

Unofficial PHP Client for Pinecone Vector Database (pinecone.io)

Go to Download


webignition/robots-txt-file

19 Favers
1016396 Downloads

Models a robots.txt file

Go to Download


vipnytt/robotstxtparser

27 Favers
659221 Downloads

Robots.txt parsing library, with full support for every directive and specification.

Go to Download


verschuur/laravel-robotstxt

38 Favers
306829 Downloads

Set the robots.txt content dynamically based on the Laravel app environment.

Go to Download


t1gor/robots-txt-parser

88 Favers
476337 Downloads

PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.

Go to Download


healey/robots

40 Favers
188225 Downloads

Robots.txt Generator for Laravel 4 and 5

Go to Download


bopoda/robots-txt-parser

45 Favers
189817 Downloads

PHP Class for parsing robots.txt files according to Google, Yandex specifications.

Go to Download


novactive/ezseobundle

29 Favers
230222 Downloads

Novactive eZ SEO Bundle is an Ibexa Platform bundle for SEO simplications. metas, sitemaps, robots.txt, etc.

Go to Download


marcortola/behat-seo-contexts

13 Favers
110480 Downloads

Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang, meta robots, robots.txt, redirects, sitemap validation, HTML validation, performance...

Go to Download


monperrus/crawler-user-agents

1263 Favers
1799 Downloads

This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.

Go to Download


tractorcow/silverstripe-robots

14 Favers
82240 Downloads

Simple robots generation module for Silverstripe

Go to Download


tomverran/robots-txt-checker

13 Favers
48423 Downloads

Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page

Go to Download


mguinea/laravel-robots

17 Favers
46577 Downloads

Laravel package to manage robots in an easy way

Go to Download


<< Previous Next >>