PHP download

Download the PHP package flyokai/amp-data-pipeline without Composer

On this page you can find all versions of the php package flyokai/amp-data-pipeline. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.

Table of contents
Download flyokai/amp-data-pipeline
More information about flyokai/amp-data-pipeline
Files in flyokai/amp-data-pipeline

Vendor flyokai
Package amp-data-pipeline
Short Description Async data pipeline using amphp
License MIT

FAQ

After the download, you have to make one include require_once('vendor/autoload.php');. After that you have to import the classes with use statements.

Example:

If you use only one package a project is not needed. But if you use more then one package, without a project it is not possible to import the classes with use statements.

In general, it is recommended to use always a project to download your libraries. In an application normally there is more than one library needed.

Some PHP packages are not free to download and because of that hosted in private repositories. In this case some credentials are needed to access such packages. Please use the auth.json textarea to insert credentials, if a package is coming from a private repository. You can look here for more information.

Some hosting areas are not accessible by a terminal or SSH. Then it is not possible to use Composer.
To use Composer is sometimes complicated. Especially for beginners.
Composer needs much resources. Sometimes they are not available on a simple webspace.
If you are using private repositories you don't need to share your credentials. You can set up everything on our site and then you provide a simple download link to your team member.
Simplify your Composer build process. Use our own command line tool to download the vendor folder as binary. This makes your build process faster and you don't need to expose your credentials for private repositories.

Please rate this library. Is it a good library?

Example code of flyokai/amp-data-pipeline

Informations about the package amp-data-pipeline

flyokai/amp-data-pipeline

User docs → AGENTS.md

Composable async data pipelines on AMPHP 3.x — sources, processors, batching, multicast, with explicit concurrency and backpressure controls.

A small toolkit for building pull-based concurrent processing pipelines. You wire together a DataSource and one or more Processors; each processor controls its own fiber count and output queue size. Batch and multicast operators give you the rest.

Features

DataItem wrapper — data + meta arrays, immutable-ish
Sources — ArraySource, IteratorSource, QueueSource
Processors — ProcessorAbstract (override processDataItem()), SkipProcessor
Composition — ProcessorComposition chains stages sequentially
Batching — Batch\BatchProcessor groups items and creates a per-batch processor
Multicast — DataCast\MultiCastProcessor fans out each item to parallel cast processors
Per-stage concurrency — fiber count, buffer size, optional ordering
Cancellation propagated through the chain

Installation

Quick start

Concepts

`DataItem`

Sources

Class	Use case
`ArraySource`	wraps a PHP array (`ConcurrentArrayIterator`)
`IteratorSource`	wraps any `iterable`
`QueueSource`	wraps an AMPHP `Queue` for push-based input

Processors

ProcessorAbstract gives you:

setConcurrency(int) — fiber count inside the stage
setBufferSize(int) — output queue depth (0 = same as concurrency)
setCancellation(Cancellation) — graceful shutdown
releaseDataItem(DataItem) — push to output

Linear pipeline

Batching

Items accumulate up to batchSize, a fresh processor is built for each batch, and results are routed through a DataItemHandler strategy.

Multicast

Each input item is delivered to every cast processor in parallel; outputs are aggregated by MultiCastConsumer.

Handler strategies

DataItemHandler is the strategy for handling specific items:

HandlerComposition enforces mutual exclusion — exactly one handler per item; multiple matches throw. Pass $ordered = true to preserve item order via Mutex / Sequence.

Concurrency model

Inter-stage: a ProcessorComposition chains iterators (pull-based, demand-driven).
Intra-stage: concurrency controls the number of fibers servicing the queue inside a processor.
Buffer: bufferSize decouples producer/consumer (set to 0 to mirror concurrency).
Multicast: every cast processor fires simultaneously per item.
Backpressure: queue + groupBufferSize cap memory growth.

Gotchas

Order is not preserved by default. Use $ordered = true on BatchProcessor or HandlerComposition if you need it.
reset() requires queue completion. Resetting an incomplete queue throws RuntimeException.
Handler exclusivity — a HandlerComposition enforces one handler per item. Two matching handlers throw.
CastProcessor ≠ Processor. Cast processors receive a raw ConcurrentIterator and own their queues.
groupBufferSize = 0 is unlimited. Multicast with grouping can grow memory unboundedly.
Cancellation must propagate. ProcessorComposition propagates to children automatically, but custom compositions need to do this explicitly.
Reflection in error handling — errorDisposeQueue() reaches into Queue internals via reflection. AMPHP version updates may break it.

License

MIT

All versions of amp-data-pipeline with dependencies

PHP Build Version

Package Version

Version v1.1.8 Release 09. Jun 2026
create-project require 0 people chose require and
0 people chose create-project.

Download

Download latest version of amp-data-pipeline from vendor flyokai

Requires php Version ^8.1
amphp/amp Version ^3
amphp/pipeline Version ^1

Composer command for our command line client (download client) This client runs in each environment. You don't need a specific PHP version etc. The first 20 API calls are free. Standard composer command

The package flyokai/amp-data-pipeline contains the following files

Loading the files please wait ...