Download the PHP package imamuseum/harvester2 without Composer
On this page you can find all versions of the php package imamuseum/harvester2. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download imamuseum/harvester2
More information about imamuseum/harvester2
Files in imamuseum/harvester2
Package harvester2
Short Description Second version of Online collection data harvester.
License MIT
Informations about the package harvester2
Harvester Package
This is a large overhaul of the harvester. The focus of this project was to optimize the harvester to avoid extraneous querying and allow que-able processing.
Composer Setup
Service Provider
In config/app.php
add to the autoloaded providers -
Add ExampleHarvester to app/Providers/AppServiceProvider.php
to implement the HarvesterInterface.
Now you can publish the package -
Push items off the queue Harvester 2 pushes delete jobs onto a queue named "high" and update jobs onto the default queue. This allows the user to define a high and low priority queue to insure delete jobs are run before update jobs.
Harvester2 has the flexibility to work with any queue and any document store. At the moment ElasticSearch is the only Document Store that has been implemented. Personally I suggest using Redis as a queue as it plays well with Laravel. If you intend to use sqlite as a queue be sure to use an instance separate from any of your sources (if any of your sources are sqlite databases. The lack of concurrency may cause jobs to fail.
Artisan Commands
Use the --help flag after any command to view the available options with a description.
Supported Sources
- Piction
- Proficio
- Generic API source
- Generic Query source
Supported Document Stores
- ElasticSearch 5.0
License
The Laravel framework is open-sourced software licensed under the MIT license.