Download the PHP package get-crawly/magento2-crawly without Composer
On this page you can find all versions of the php package get-crawly/magento2-crawly. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Table of contents
Download get-crawly/magento2-crawly
More information about get-crawly/magento2-crawly
Files in get-crawly/magento2-crawly
Download get-crawly/magento2-crawly
More information about get-crawly/magento2-crawly
Files in get-crawly/magento2-crawly
Vendor get-crawly
Package magento2-crawly
Short Description Free Magento 2 extension that automatically generates dynamic llms.txt, llms-full.txt and agents.md files for every store view, helping AI search engines and LLMs better understand and discover your storefront.
License MIT
Package magento2-crawly
Short Description Free Magento 2 extension that automatically generates dynamic llms.txt, llms-full.txt and agents.md files for every store view, helping AI search engines and LLMs better understand and discover your storefront.
License MIT
FAQ
After the download, you have to make one include require_once('vendor/autoload.php');. After that you have to import the classes with use statements.
Example:
Example:
If you use only one package a project is not needed. But if you use more then one package, without a project it is not possible to import the classes with use statements.
In general, it is recommended to use always a project to download your libraries. In an application normally there is more than one library needed.
In general, it is recommended to use always a project to download your libraries. In an application normally there is more than one library needed.
Some PHP packages are not free to download and because of that hosted in private repositories.
In this case some credentials are needed to access such packages.
Please use the auth.json textarea to insert credentials, if a package is coming from a private repository.
You can look here for more information.
- Some hosting areas are not accessible by a terminal or SSH. Then it is not possible to use Composer.
- To use Composer is sometimes complicated. Especially for beginners.
- Composer needs much resources. Sometimes they are not available on a simple webspace.
- If you are using private repositories you don't need to share your credentials. You can set up everything on our site and then you provide a simple download link to your team member.
- Simplify your Composer build process. Use our own command line tool to download the vendor folder as binary. This makes your build process faster and you don't need to expose your credentials for private repositories.
Please rate this library. Is it a good library?
Informations about the package magento2-crawly
Limely_Crawly — Magento 2 Module
AI visibility and discovery tools for Magento 2, built by Limely.
Automatically serves llms.txt, llms-full.txt, and agents.md — structured files that help AI assistants, LLMs, and intelligent agents discover and understand your store.
Features
- Serves
/llms.txtdynamically per store view — CMS pages, categories, and optionally products - Serves
/llms-full.txt— top 100 best-selling products over a configurable period (falls back to 100 catalog products when disabled or no sales data), plus all categories and CMS pages - Serves
/agents.md— agent instructions including platform info, Hyvä detection, REST API / GraphQL endpoints (shown or hidden based on your anonymous access setting), transacting steps, and custom content - Full multi-store support — all output and configuration is scoped per store view
- Hyvä theme detection per store view — walks the full theme parent chain, so child themes built on Hyvä are correctly detected
- Sitemap link in
agents.mdonly included if the sitemap file actually exists on disk - REST API section in
agents.mdautomatically toggled by Stores > Configuration > Services > Magento Web API > Web API Security - Custom introduction and custom content fields per file
- Optional AI attribution section with separate content per file
- Fully configurable via Stores > Configuration > Limely > Crawly
Requirements
- Magento 2.4+
- PHP 8.1+
Installation
Configuration
llms.txt Generator
Stores > Configuration > Limely > Crawly > llms.txt Generator
| Option | Default | Description |
|---|---|---|
| Enabled | Yes | Enable/disable /llms.txt and /llms-full.txt |
| Include CMS Pages | Yes | Add active CMS pages scoped to the current store view |
| Include Categories | Yes | Add active categories |
| Include Products | No | Add visible, enabled products (up to 500) |
| Best Sellers in llms-full.txt | Yes | Order llms-full.txt products by quantity sold. Disable on very large stores if generation is slow |
| Best Sellers Period (Days) | 90 | Only count orders from the last N days. 0 = all time |
| Custom Introduction | — | Optional text shown below the store name |
| Include Attribution | Yes | Appends an AI Discovery section — content differs per file |
agents.md Generator
Stores > Configuration > Limely > Crawly > agents.md Generator
| Option | Default | Description |
|---|---|---|
| Enabled | Yes | Enable/disable /agents.md |
| Custom Introduction | — | Inserted after the store name heading |
| Custom Content | — | Appended at the end — use markdown, good for contact details or agent-specific instructions |
Generated files
/llms.txt
A structured plain-text summary of your store for language models — store name, CMS pages, categories, and optionally products, based on your configuration.
/llms-full.txt
A full content listing — all CMS pages, all categories, and the top 100 best-selling products ordered by quantity sold across the current website over the configured period (default 90 days). Falls back to 100 catalog products when best sellers are disabled or there is no sales data in the period.
/agents.md
Agent instructions in markdown format. Auto-generated sections include:
- Platform — Magento 2, plus a Hyvä note if the current store view uses the Hyvä theme
- Read-Only Browsing — REST API endpoints and GraphQL, shown only if anonymous access is enabled; replaced with an authentication notice if not
- Store Resources — links to sitemap (if it exists),
llms.txt,llms-full.txt, andagents.md - Transacting — guest cart and checkout flow with a human-approval note
- AI Agent Guidance — attribution section with AI Discovery, Website Development, and Guidance for AI Systems sub-sections (if attribution enabled)
- Custom Content — anything you add in the admin textarea
Output examples
llms.txt
llms-full.txt
agents.md
About
- Built by Limely — a UK ecommerce agency established in 2015, specialising in Magento, Hyvä and Shopify
- Powered by Crawly — a native macOS SEO crawler with Claude Code MCP integration
License
MIT
All versions of magento2-crawly with dependencies
PHP Build Version
Package Version
Requires
php Version
>=8.1
magento/framework Version >=100.4.0
magento/module-backend Version >=100.4.0
magento/module-catalog Version >=104.0.0
magento/module-cms Version >=104.0.0
magento/module-config Version >=101.2.0
magento/module-sales Version >=103.0.0
magento/module-store Version >=101.1.0
magento/framework Version >=100.4.0
magento/module-backend Version >=100.4.0
magento/module-catalog Version >=104.0.0
magento/module-cms Version >=104.0.0
magento/module-config Version >=101.2.0
magento/module-sales Version >=103.0.0
magento/module-store Version >=101.1.0
The package get-crawly/magento2-crawly contains the following files
Loading the files please wait ...