Download the PHP package kaliop/queueingbundle-kinesis without Composer
On this page you can find all versions of the php package kaliop/queueingbundle-kinesis. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download kaliop/queueingbundle-kinesis
More information about kaliop/queueingbundle-kinesis
Files in kaliop/queueingbundle-kinesis
Package queueingbundle-kinesis
Short Description Kaliop Queueing Bundle - Kinesis plugin
License GPL-2.0
FAQ
Example:
In general, it is recommended to use always a project to download your libraries. In an application normally there is more than one library needed.
- Some hosting areas are not accessible by a terminal or SSH. Then it is not possible to use Composer.
- To use Composer is sometimes complicated. Especially for beginners.
- Composer needs much resources. Sometimes they are not available on a simple webspace.
- If you are using private repositories you don't need to share your credentials. You can set up everything on our site and then you provide a simple download link to your team member.
- Simplify your Composer build process. Use our own command line tool to download the vendor folder as binary. This makes your build process faster and you don't need to expose your credentials for private repositories.
Informations about the package queueingbundle-kinesis
Kaliop Queueing Bundle - Kinesis plugin
Adds support for AWS Kinesis to the Kaliop Queueing Bundle
See: http://aws.amazon.com/kinesis/ and https://github.com/kaliop-uk/kueueingbundle respectively.
It has been given its own bundle because it has higher requirements than the base Queueing Bundle
Installation
-
Install the bundle via Composer.
-
Enable the KaliopQueueingPluginsKinesisBundle bundle in your kernel class registerBundles(). Also enable the DoctrineCacheBundle.
- Clear all caches if not on a dev environment
Usage
-
If you do not have an AWS account, sign up for one at http://aws.amazon.com/ NB: note that there is no free tier for Kinesis. Pricing is described at: http://aws.amazon.com/kinesis/pricing/
-
Create a Kinesis stream, using the web interface: https://console.aws.amazon.com/kinesis/home
-
Set up configuration according to your AWS account
- edit parameters.yml in this bundle
- copy/include kinesis_sample.yml in your app config, and edit it if needed
-
check that you can list the stream, and the shards in it:
php app/console kaliop_queueing:managequeue list -bkinesis php app/console kaliop_queueing:managequeue info -bkinesis <stream> -
push a message to the stream
php app/console kaliop_queueing:queuemessage -bkinesis -r<shard-partition> <stream> <jsonpayload> -
receive messages from the stream
php app/console kaliop_queueing:consumer -bkinesis -r<shard-id> <stream>
Notes
-
Kinesis groups messages in streams, which are divided into one or more shards each. Each message is pushed onto a shard, and has to be pulled from it. In kaliop-queueing, the following mapping applies:
- stream => queue
- shard => routing key
-
Kinesis by default does not remove messages from its shards when they are consumed. This means that the consumer has to keep an internal pointer to the last consumed message. A service is used to handle the local storage of this value - the default one provided in this bundle is based on the Doctrine-Cache bundle, and has to be configured to be enabled (see point 7 above). Note that since it uses the cache directory to store the data, on any cache clear the pointer will be reset, and old messages downloaded. To change this behaviour, see the option kaliop_queueing_kinesis.default.missing_sequence_number_strategy in parameters.yml
-
When running the kaliop_queueing:queuemessage, usage of the -r option to specify a shard partition key is mandatory. NB: the value used is not the id of the shard, rather it is hashed and a shard is picked according to the hash value
- When running the kaliop_queueing:messageconsumer, usage of the -r option to specify a shard Id is mandatory.
If you do not know the Shard Id, use the
kaliop_queueing:managequeue info <stream>command to see it
All versions of queueingbundle-kinesis with dependencies
aws/aws-sdk-php Version ^3.0
symfony/config Version ^2.4 || ^3.0 || ^4.0
symfony/dependency-injection Version ^2.4 || ^3.0 || ^4.0
symfony/http-kernel Version ^2.4 || ^3.0 || ^4.0
doctrine/doctrine-cache-bundle Version *