Libraries tagged by tx

This is Pico's official robots plugin to add a robots.txt and sitemap.xml to your website. Pico is a stupidly simple, blazing fast, flat file CMS.

Go to Download

Generative Engine Optimization for Neos CMS - Generate llms.txt and llms-full.txt files for AI/LLM consumption

Go to Download

Class to check a URL for robots exclusion using all possible methods of robots exclusion

Go to Download

Agnostic model to efficiently query and scroll any kind of data (SQL, Search engine, HTTP API, CSV, ...) and push them anywhere with a ETL

Go to Download

Panth Robots SEO — dedicated robots.txt, X-Robots-Tag, and LLM-bot (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.) policy control for Magento 2. Extracted from Panth_AdvancedSEO. Self-contained: emits a per-store robots.txt, adds X-Robots-Tag response headers, validates robots meta directives, and exposes admin CRUD for user-agent / path policies. Hyva and Luma compatible.

Go to Download

PHP API for interacting with the XRP Ledger

Go to Download

Instant indexing and GEO for Craft CMS — push URLs to Google's Indexing API and IndexNow the moment they change, then manage, log and audit how AI search engines read your site.

Go to Download

Seoquent - A powerful all-in-one Laravel SEO package. Meta tags, Open Graph, Twitter Cards, JSON-LD structured data, sitemap generation, robots.txt, and per-model SEO management.

Go to Download

Generate sitemap.xml and robots.txt files in Laravel or any PHP Application with ease.

Go to Download

Fast, SEO- and AI-agent-friendly API documentation for Laravel applications.

Go to Download

A simple package that converts HTML into plain text using DOM methods

Go to Download

Centrally manages robots.txt, the robots head meta tag and XML sitemap inclusion for any TYPO3 site (single-site or multisite), with environment-aware safety logic that guards production against accidental crawl-blocking while keeping staging/dev fully disallowed.

Go to Download

parser/handler for Robots Exclusion Protocol (robots.txt and more)

Go to Download

Exclude single files/images from search engines (Google Image Search) via a dynamically generated robots.txt - toggled per file in the file list.

Go to Download

A powerful library for manipulating and converting PDF files.

Go to Download