Libraries tagged by robots
monperrus/crawler-user-agents
7158 Downloads
This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.
georgringer/news-seo
113364 Downloads
Indivdual indexing/robot information for each news article record
ymlluo/group-robot
5765 Downloads
钉钉、企业微信、飞书 自定义群组机器人。支持链式语法创建发送消息。支持文本、Markdown、图片、文件、图文、卡片等消息。
tractorcow/silverstripe-robots
101460 Downloads
Simple robots generation module for Silverstripe
crwlr/robots-txt
39060 Downloads
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
mguinea/laravel-robots
68983 Downloads
Laravel package to manage robots in an easy way
tomverran/robots-txt-checker
67887 Downloads
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page
monsieurbiz/sylius-robots-txt-plugin
18328 Downloads
Manage your robot.txt from your Sylius admin pannel
merkandi/laravel-5-robots
41358 Downloads
Robots.txt Generator for Laravel 5
frosh/robots-txt
38188 Downloads
Generate robots.txt
bnomei/kirby3-robots-txt
50989 Downloads
Manage a virtual robots.txt from the Kirby config file
ellisthedev/laravel-5-robots
214840 Downloads
Robots.txt Generator for Laravel 5
vipnytt/useragentparser
1035546 Downloads
User-Agent parser for robot rule sets
chowjiawei/laravel-help-plugin
2155 Downloads
Integrating useful auxiliary functions into laravel,Assistant tools based on laravel.
spryker/robotframework-suite-tests
101028 Downloads
Automated tests for the Robot Framework