Download the PHP package flowpack/elasticsearch-contentrepositoryqueueindexer without Composer
On this page you can find all versions of the php package flowpack/elasticsearch-contentrepositoryqueueindexer. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download flowpack/elasticsearch-contentrepositoryqueueindexer
More information about flowpack/elasticsearch-contentrepositoryqueueindexer
Files in flowpack/elasticsearch-contentrepositoryqueueindexer
Package elasticsearch-contentrepositoryqueueindexer
Short Description Neos CMS Elasticsearch indexer based on a job queue
License MIT
Informations about the package elasticsearch-contentrepositoryqueueindexer
Neos CMS Elasticsearch indexer based on a job queue
This package can be used to index a huge amount of nodes in Elasticsearch indexes. This package use the Flowpack JobQueue packages to handle the indexing asynchronously.
Topics
- Installation
- Indexing
- SupervisorD configuration
- Update Instructions
Installation and Configuration
You need to install the correct Queue package based on your needs.
Available packages:
Please check the package documentation for specific configurations.
The default configuration uses the FakeQueue, which is provided by the JobQueue.Common package. Note that with that package jobs are executed synchronous with the flow nodeindexqueue:build command.
Check the to adapt based on the Queue package, you need to adapt the :
Flowpack:
JobQueue:
Common:
presets:
'Flowpack.ElasticSearch.ContentRepositoryQueueIndexer':
className: 'Flowpack\JobQueue\Common\Queue\FakeQueue'
If you use the doctrine package you have to set the manually:
Flowpack:
JobQueue:
Common:
presets:
'Flowpack.ElasticSearch.ContentRepositoryQueueIndexer':
className: 'Flowpack\JobQueue\Doctrine\Queue\DoctrineQueue'
queues:
'Flowpack.ElasticSearch.ContentRepositoryQueueIndexer':
options:
tableName: 'flowpack_jobqueue_QueueIndexer'
'Flowpack.ElasticSearch.ContentRepositoryQueueIndexer.Live':
options:
tableName: 'flowpack_jobqueue_QueueIndexerLive'
Indexing
Batch Indexing
How to build indexing jobs
flow nodeindexqueue:build --workspace live
How to process indexing jobs
You can use this CLI command to process indexing job:
flow nodeindexqueue:work --queue batch
Live Indexing
You can disable async live indexing by editing :
Flowpack:
ElasticSearch:
ContentRepositoryQueueIndexer:
enableLiveAsyncIndexing: false
You can use this CLI command to process indexing job:
flow nodeindexqueue:work --queue live
Supervisord configuration
You can use tools like to manage long running processes. Bellow you can find a basic configuration:
[supervisord]
[supervisorctl]
[program:elasticsearch_batch_indexing]
command=php flow nodeindexqueue:work --queue batch
stdout_logfile=AUTO
stderr_logfile=AUTO
numprocs=4
process_name=elasticsearch_batch_indexing_%(process_num)02d
environment=FLOW_CONTEXT="Production"
autostart=true
autorestart=true
stopsignal=QUIT
[program:elasticsearch_live_indexing]
command=php flow nodeindexqueue:work --queue live
stdout_logfile=AUTO
stderr_logfile=AUTO
numprocs=4
process_name=elasticsearch_live_indexing_%(process_num)02d
environment=FLOW_CONTEXT="Production"
autostart=true
autorestart=true
stopsignal=QUIT
Update Instructions
Breaking change after an upgrade to 3.0
- Previously the Beanstalk queue package was installed by default, this is no longer the case.
Breaking change after an upgrade to 5.0
- The beanstalk queue configuration is removed. The FakeQueue is used if not configured to another queuing package.
License
Licensed under MIT, see LICENSE
All versions of elasticsearch-contentrepositoryqueueindexer with dependencies
flowpack/jobqueue-common Version ^3.0 || dev-master
flowpack/elasticsearch-contentrepositoryadaptor Version ^7.0 || ^8.0 || dev-master