Libraries tagged by robot
monperrus/crawler-user-agents
6397 Downloads
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
georgringer/news-seo
103934 Downloads
Indivdual indexing/robot information for each news article record
ymlluo/group-robot
5039 Downloads
钉钉、企业微信、飞书 自定义群组机器人。支持链式语法创建发送消息。支持文本、Markdown、图片、文件、图文、卡片等消息。
tractorcow/silverstripe-robots
99690 Downloads
Simple robots generation module for Silverstripe
mguinea/laravel-robots
64960 Downloads
Laravel package to manage robots in an easy way
crwlr/robots-txt
35850 Downloads
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
tomverran/robots-txt-checker
64993 Downloads
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page
spryker/robotframework-suite-tests
98647 Downloads
Automated tests for the Robot Framework
monsieurbiz/sylius-robots-txt-plugin
14209 Downloads
Manage your robot.txt from your Sylius admin pannel
frosh/robots-txt
36805 Downloads
Generate robots.txt
bnomei/kirby3-robots-txt
50271 Downloads
Manage a virtual robots.txt from the Kirby config file
vipnytt/useragentparser
998943 Downloads
User-Agent parser for robot rule sets
chowjiawei/laravel-help-plugin
1885 Downloads
Integrating useful auxiliary functions into laravel,Assistant tools based on laravel.
robotusers/cakephp-table-inheritance
260734 Downloads
Robotusers CakePHP STI & CTI pattern plugin
eliashaeussler/typo3-sitemap-locator
328634 Downloads
Sitemap Locator - Looks up XML sitemaps as part of a configured site. Supports various sitemap providers, e.g. by configured page type or robots.txt, and allows to implement custom providers.