Download the PHP package symfony-doge/veslo without Composer
On this page you can find all versions of the php package symfony-doge/veslo. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download symfony-doge/veslo
More information about symfony-doge/veslo
Files in symfony-doge/veslo
Package veslo
Short Description A vacancy aggregation engine
License GPL-3.0-or-later
Homepage https://github.com/symfony-doge/veslo
Informations about the package veslo
________________________ / \ ,--. / | | |___________________________________________/_____________________ | | |_________________________________________________________________) | | | \ | `--' \ | \________________________/ Veslo: a vacancy aggregation engine
Installation
Docker
The preferred way to install is through docker-compose.
You need to have a Docker daemon at least 17.05.0-ce
(with build-time ARG
in FROM
) to successfully cook all containers.
Run an automated deploy script for local development with Docker.
Roadmap configurations were not automatically loaded by the script, you need to insert them manually with a separate command.
Up to 120 sec may be required for starting up the vacancy parsing process.
Manual
You can clone and deploy the application with your own environment
by providing .env
file using .env.dev.dist
as a template.
Below are steps to prepare your application before accessing through a web server.
Check your environment for Symfony requirements and install PHP dependencies via Composer. You also need the php-ds extension for some services working with efficient PHP 7 data structures.
Install Javascript dependencies and compile assets via Yarn (Node.js 10.x is required).
Apply database migrations.
Load roadmap configurations.
Testing
Loading fixtures.
Applying Codeception parameters.
Executing tests.
Workflow
There is a set of log files suited for debugging an each workflow transition.
var/logs
contains:
Log file | Description |
---|---|
dev.anthill.digging-YYYY-mm-dd.log |
Search process (to_parse) |
dev.anthill.parsing-YYYY-mm-dd.log |
Parsing process (to_collect) |
dev.anthill.collecting-YYYY-mm-dd.log |
Saving in local storage (to_index) |
dev.sanity.indexing-YYYY-mm-dd.log |
Analysis |
dev.app.workflow-YYYY-mm-dd.log |
Queue get/push events (data distribution between workers) |
dev.app.http-YYYY-mm-dd.log |
Dumping all HTTP requests/responses (works if app.http_client.logging is true ) |
dev-YYYY-mm-dd.log |
A common Symfony log file |
API
Finds a vacancy from job site by roadmap (search plan) and configuration.
Search result will be offered to parsing queue,
according to current workflow (default veslo.app.workflow.vacancy_research.to_parse
).
Available roadmaps are defined in AnthillBundle/Resources/config/roadmaps.yml
and configurations in AnthillBundle/Resources/fixtures/roadmap/
.
Polls a new raw vacancy data (html/json etc.) for parsing.
Result will be offered to collecting queue
(default veslo.app.workflow.vacancy_research.to_collect
).
Grabs a parsed vacancy data (instance of AnthillBundle/Dto/Vacancy/RawDto
)
and decides whether should it be collected for analysis or not.
Result will be persisted in the local storage and offered to the indexing queue
(default veslo.app.workflow.vacancy_research.to_index
)
Sends an accepted vacancy to the microservice for analysis (see ANALYSER_HOST
, ANALYSER_PORT
)
and persists received metadata in the local storage. Remote service implements
API defined by symfony-doge/ministry-of-truth-client bridge.
Example (Go + Gin): symfony-doge/ministry-of-truth-cis.
Currently supported roadmaps:
- hh (configurations:
php
,javascript
,golang
,python
,java
,c++
)
Usage example
See also
- symfony-doge/management-kit — A set of monitoring & management GUI tools to manage data & processes of this project.
Changelog
All notable changes to this project will be documented in CHANGELOG.md.
All versions of veslo with dependencies
bunny/bunny Version ^0.4.1
doctrine/doctrine-bundle Version ^1.6
doctrine/doctrine-fixtures-bundle Version ^3.1
doctrine/doctrine-migrations-bundle Version ^1.0
doctrine/orm Version ^2.5
guzzlehttp/guzzle Version ^6.3
incenteev/composer-parameter-handler Version ^2.0
knplabs/knp-menu-bundle Version ^2.2
knplabs/knp-paginator-bundle Version ^2.8
nelmio/alice Version ^3.5
sensio/distribution-bundle Version ^5.0.19
sensio/framework-extra-bundle Version ^5.0.0
shivas/versioning-bundle Version ^3.1
stof/doctrine-extensions-bundle Version ^1.3
symfony-doge/ministry-of-truth-client Version ^0.1.1
symfony/monolog-bundle Version ^3.1.0
symfony/polyfill-apcu Version ^1.0
symfony/swiftmailer-bundle Version ^2.6.4
symfony/symfony Version 3.4.*
twig/extensions Version ^1.5
twig/twig Version ^1.0||^2.0