Download the PHP package bentools/etl without Composer
On this page you can find all versions of the php package bentools/etl. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Package etl
Short Description PHP ETL (Extract / Transform / Load) implementation, with very few dependencies.
License MIT
FAQ
Example:
In general, it is recommended to use always a project to download your libraries. In an application normally there is more than one library needed.
- Some hosting areas are not accessible by a terminal or SSH. Then it is not possible to use Composer.
- To use Composer is sometimes complicated. Especially for beginners.
- Composer needs much resources. Sometimes they are not available on a simple webspace.
- If you are using private repositories you don't need to share your credentials. You can set up everything on our site and then you provide a simple download link to your team member.
- Simplify your Composer build process. Use our own command line tool to download the vendor folder as binary. This makes your build process faster and you don't need to expose your credentials for private repositories.
Informations about the package etl
Okay, so you heard about the Extract / Transform / Load pattern, and you're looking for a PHP library to do the stuff. Alright, let's go!
bentools/etl is a versatile PHP library for implementing the Extract, Transform, Load (ETL) pattern, designed to streamline data processing tasks.
Table of Contents
- Concepts
- Installation
- Getting started
- The EtlState object
- Skipping items
- Stopping the workflow
- Using events
- Flush frequency and early flushes
- Advanced Usage
- Creating your own Extractor / Transformers / Loaders
- Difference between yield and return in transformers
- Next tick
- Chaining extractors / transformers / loaders
- Reading from STDIN / Writing to STDOUT
- Instantiators
- Using ReactPHP
- Recipes
- Contributing
- License
Concepts
Let's cover the basic concepts:
- Extract: you have a source of data (a database, a CSV file, whatever) - an extractor is able to read that data and provide an iterator of items
- Transform: apply transformation to each item. A transformer may generate 0, 1 or several items to load (for example, 1 item may generate multiple SQL queries)
- Load: load transformed item to the destination. For example, extracted items have been transformed to SQL queries, and your loader will run those queries against your database.
Installation
[!WARNING] Current version (4.0) is a complete redesign and introduces significant BC (backward compatibility) breaks. Avoid upgrading from
^2.0or^3.0unless you're fully aware of the changes.
Usage
Now let's have a look on how simple it is:
OK, that wasn't really hard, here we basically don't have to extract anything (we can already iterate on $singers),
and we're not loading anywhere, except into PHP's memory.
You may ask, "why don't you just array_map('strtoupper', $singers) ?" and you're totally right.
But sometimes, extracting, transforming and / or loading get a little more complex. You may want to extract from a file, a crawled content on the web, perform one to many transformations, maybe skip some items, or reuse some extraction, transformation or loading logic.
Here's another example of what you can do:
Or:
You get the point. Now you're up to write your own workflows!
Continue reading the Getting Started Guide.
Contribute
Contributions are welcome! Don't hesitate to suggest recipes.
This library is 100% covered with Pest tests.
Please ensure to run tests using the command below and maintain code coverage before submitting PRs.
License
MIT.
All versions of etl with dependencies
psr/event-dispatcher Version ^1.0
psr/log Version ^3.0
symfony/options-resolver Version @stable
thecodingmachine/safe Version ^2.5