Download the PHP package innmind/crawler-app without Composer
On this page you can find all versions of the php package innmind/crawler-app. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Table of contents
Download innmind/crawler-app
More information about innmind/crawler-app
Files in innmind/crawler-app
Download innmind/crawler-app
More information about innmind/crawler-app
Files in innmind/crawler-app
Vendor innmind
Package crawler-app
Short Description Crawl the web and publish the graph to an api
License proprietary
Package crawler-app
Short Description Crawl the web and publish the graph to an api
License proprietary
Please rate this library. Is it a good library?
Informations about the package crawler-app
Crawler Robot
This is an app to crawl internet and publish resource attributes to a Library.
Installation
Copy config/.env.dist
to config/.env
and adapt the url of the amqp server to your need.
Usage
This will launch a consumer to read the urls to crawl
This will crawl http://the.url/to/crawl
, extract the resource attributes and publish them to the library https://innmind_library.host/
. It will automatically detect the api resource to publish to.
All versions of crawler-app with dependencies
PHP Build Version
Package Version
Requires
php Version
~7.4
innmind/crawler Version ~6.0
innmind/robots-txt Version ~5.0
innmind/operating-system Version ~2.0
innmind/amqp Version ~3.0
innmind/cli Version ~2.0
monolog/monolog Version ~2.0
symfony/dotenv Version ~5.0
innmind/logger Version ~2.0
innmind/rest-client Version ~8.0
innmind/homeostasis Version ~4.0
innmind/installation-monitor Version ~3.0
innmind/json Version ^1.1
innmind/silent-cartographer Version ~2.0
innmind/stack Version ^1.0
innmind/ipc Version ~3.0
innmind/genome Version ^3.0
innmind/cli-framework Version ^1.2
innmind/crawler Version ~6.0
innmind/robots-txt Version ~5.0
innmind/operating-system Version ~2.0
innmind/amqp Version ~3.0
innmind/cli Version ~2.0
monolog/monolog Version ~2.0
symfony/dotenv Version ~5.0
innmind/logger Version ~2.0
innmind/rest-client Version ~8.0
innmind/homeostasis Version ~4.0
innmind/installation-monitor Version ~3.0
innmind/json Version ^1.1
innmind/silent-cartographer Version ~2.0
innmind/stack Version ^1.0
innmind/ipc Version ~3.0
innmind/genome Version ^3.0
innmind/cli-framework Version ^1.2
The package innmind/crawler-app contains the following files
Loading the files please wait ....