Libraries tagged by txt

spatie/robots-txt

263 Favers
18494911 Downloads

Determine if a page may be crawled from robots.txt and robots meta tags

Go to Download


vipnytt/sitemapparser

83 Favers
2328794 Downloads

XML Sitemap parser class compliant with the Sitemaps.org protocol.

Go to Download


webignition/robots-txt-file

19 Favers
1403957 Downloads

Models a robots.txt file

Go to Download


bopoda/robots-txt-parser

48 Favers
287578 Downloads

PHP Class for parsing robots.txt files according to Google, Yandex specifications.

Go to Download


vipnytt/robotstxtparser

27 Favers
787404 Downloads

Robots.txt parsing library, with full support for every directive and specification.

Go to Download


soapbox/laravel-formatter

258 Favers
1081753 Downloads

A formatting library that converts data output between XML, CSV, JSON, TXT, YAML and a few others.

Go to Download


t1gor/robots-txt-parser

90 Favers
501418 Downloads

PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.

Go to Download


stolt/llms-txt-php

25 Favers
19532 Downloads

A library for writing, reading, and validating llms.txt Markdown files.

Go to Download


crwlr/robots-txt

11 Favers
34203 Downloads

Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping

Go to Download


verschuur/laravel-robotstxt

43 Favers
428390 Downloads

Set the robots.txt content dynamically based on the Laravel app environment.

Go to Download


novactive/ezseobundle

29 Favers
258866 Downloads

Novactive eZ SEO Bundle is an Ibexa Platform bundle for SEO simplications. metas, sitemaps, robots.txt, etc.

Go to Download


txthinking/mailer

103 Favers
102187 Downloads

A very lightweight PHP SMTP mail sender

Go to Download


marcortola/behat-seo-contexts

13 Favers
168525 Downloads

Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang, meta robots, robots.txt, redirects, sitemap validation, HTML validation, performance...

Go to Download


lukemadhanga/php-document-parser

39 Favers
114962 Downloads

A PHP parser for getting the text from a .doc, .docx, .rtf or .txt file

Go to Download


healey/robots

38 Favers
209258 Downloads

Robots.txt Generator for Laravel 4 and 5

Go to Download


Next >>