Libraries tagged by robots

This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.

Go to Download

钉钉、企业微信、飞书 自定义群组机器人。支持链式语法创建发送消息。支持文本、Markdown、图片、文件、图文、卡片等消息。

Go to Download

Simple robots generation module for Silverstripe

Go to Download

Laravel package to manage robots in an easy way

Go to Download

Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping

Go to Download

钉钉智能群助手 Laravel/Lumen 消息通知扩展包（Dingtalk robot message notifications for Laravel/Lumen）

Go to Download

Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page

Go to Download

Generate robots.txt

Go to Download

Manage a virtual robots.txt from the Kirby config file

Go to Download

User-Agent parser for robot rule sets

Go to Download

Integrating useful auxiliary functions into laravel,Assistant tools based on laravel.

Go to Download

Indivdual indexing/robot information for each news article record

Go to Download

PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

Go to Download

企业微信机器人sdk

Go to Download

A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience

Go to Download