Libraries tagged by txt
spatie/robots-txt
18494911 Downloads
Determine if a page may be crawled from robots.txt and robots meta tags
vipnytt/sitemapparser
2328794 Downloads
XML Sitemap parser class compliant with the Sitemaps.org protocol.
webignition/robots-txt-file
1403957 Downloads
Models a robots.txt file
bopoda/robots-txt-parser
287578 Downloads
PHP Class for parsing robots.txt files according to Google, Yandex specifications.
vipnytt/robotstxtparser
787404 Downloads
Robots.txt parsing library, with full support for every directive and specification.
soapbox/laravel-formatter
1081753 Downloads
A formatting library that converts data output between XML, CSV, JSON, TXT, YAML and a few others.
t1gor/robots-txt-parser
501418 Downloads
PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.
stolt/llms-txt-php
19532 Downloads
A library for writing, reading, and validating llms.txt Markdown files.
crwlr/robots-txt
34203 Downloads
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
verschuur/laravel-robotstxt
428390 Downloads
Set the robots.txt content dynamically based on the Laravel app environment.
novactive/ezseobundle
258866 Downloads
Novactive eZ SEO Bundle is an Ibexa Platform bundle for SEO simplications. metas, sitemaps, robots.txt, etc.
txthinking/mailer
102187 Downloads
A very lightweight PHP SMTP mail sender
marcortola/behat-seo-contexts
168525 Downloads
Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang, meta robots, robots.txt, redirects, sitemap validation, HTML validation, performance...
lukemadhanga/php-document-parser
114962 Downloads
A PHP parser for getting the text from a .doc, .docx, .rtf or .txt file
healey/robots
209258 Downloads
Robots.txt Generator for Laravel 4 and 5