Download the PHP package zappzerapp/laravel-ingest without Composer
On this page you can find all versions of the php package zappzerapp/laravel-ingest. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download zappzerapp/laravel-ingest
More information about zappzerapp/laravel-ingest
Files in zappzerapp/laravel-ingest
Package laravel-ingest
Short Description A robust, configuration-driven ETL and data import framework for Laravel. Handles CSV/Excel streaming, queues, validation, and relationships.
License MIT
Homepage https://github.com/zappzerapp/laravel-ingest
Informations about the package laravel-ingest
Stop writing spaghetti code for imports.
Laravel Ingest is a robust, configuration-driven ETL (Extract, Transform, Load) framework for Laravel. It replaces fragile, procedural import scripts with elegant, declarative configuration classes.
Whether you are importing 100 rows or 10 million, Laravel Ingest handles the heavy lifting: streaming, chunking, queueing, validation, relationships, and error reporting.
β‘ Why use this?
Most import implementations suffer from the same issues: memory leaks, timeouts, lack of validation, and messy controllers.
Laravel Ingest solves this by treating imports as a first-class citizen:
- βΎοΈ Infinite Scalability: Uses Generators and Queues to process files of any size with flat memory usage.
- π Declarative Syntax: Define what to import, not how to loop over it.
- π§ͺ Dry Runs: Simulate imports to find validation errors without touching the database.
- π Auto-Relations: Automatically resolves
BelongsToandBelongsToManyrelationships (e.g., finding IDs by names). - π‘οΈ Robust Error Handling: Tracks every failed row and allows you to download a CSV of only the failures to fix and retry.
- π API & CLI Ready: Comes with auto-generated API endpoints and Artisan commands.
π Documentation
Full documentation is available at zappzerapp.github.io/laravel-ingest.
π Quick Start
1. Installation
2. Define an Importer
Use the Artisan generator to scaffold a new importer:
Alternatively, create a class implementing IngestDefinition manually:
3. Register it
In App\Providers\AppServiceProvider:
4. Run it!
You can now trigger the import via CLI or API.
Via Artisan (Backend / Cron):
Via API (Frontend / Upload):
π‘ Demo Project
Want to see Laravel Ingest in action? Check out our Laravel Ingest Demo repository for a complete working example.
π Features in Depth
Monitoring & Management
Ingest runs happen in the background. You can monitor and manage them easily:
| Command | Description |
|---|---|
ingest:list |
Show all registered importers. |
ingest:status {id} |
Show progress bar, stats, and errors for a run. |
ingest:cancel {id} |
Stop a running import gracefully. |
ingest:retry {id} |
Create a new run containing only the rows that failed previously. |
ingest:prune-files |
Remove temporary import files older than the configured TTL. |
API Endpoints
The package automatically exposes endpoints for building UI integrations (e.g., React/Vue progress bars).
GET /api/v1/ingest- List recent runs.GET /api/v1/ingest/{id}- Get status and progress.GET /api/v1/ingest/{id}/errors/summary- Get aggregated error stats (e.g., "50x Email invalid").GET /api/v1/ingest/{id}/failed-rows/download- Download a CSV of failed rows to fix & re-upload.
Events
Hook into the lifecycle to send notifications (e.g., Slack) or trigger downstream logic.
LaravelIngest\Events\IngestRunStartedLaravelIngest\Events\ChunkProcessedLaravelIngest\Events\RowProcessedLaravelIngest\Events\IngestRunCompletedLaravelIngest\Events\IngestRunFailed
Pruning
To keep your database clean, logs are prunable. Add this to your scheduler:
π§© Configuration Reference
The IngestConfig fluent API handles complex scenarios with ease.
See the Documentation for all available methods.
β¨ Advanced Features
Beyond the basics, Laravel Ingest supports advanced capabilities for complex import scenarios:
- Validators β Rule-based and custom validators to reject rows before processing.
- Transformers & Pipelines β Chain multiple transformations on field values.
- Conditional Mappings β Apply mappings only when row conditions are met.
- Custom Sources β Define your own source types (e.g., database, API).
- Import Event Handlers β React to lifecycle events (start, progress, complete, failure).
- Nested Mappings β Handle nested data structures and one-to-many relationships.
- Schema Validation β Validate the structure of your file before processing.
- Tracing & Debugging β Inspect row-level decision trees and resolve issues fast.
π§ͺ Testing
We provide a Docker-based test environment to ensure consistency.
π€ Contributing
We welcome contributions! Please see CONTRIBUTING.md for details.
π License
The MIT License (MIT). Please see License File for more information.
All versions of laravel-ingest with dependencies
ext-fileinfo Version *
ext-json Version *
halaxa/json-machine Version ^1.2
illuminate/contracts Version ^10.0 || ^11.0 || ^12.0 || ^13.0
illuminate/database Version ^10.0 || ^11.0 || ^12.0 || ^13.0
illuminate/filesystem Version ^10.0 || ^11.0 || ^12.0 || ^13.0
illuminate/http Version ^10.0 || ^11.0 || ^12.0 || ^13.0
illuminate/queue Version ^10.0 || ^11.0 || ^12.0 || ^13.0
illuminate/support Version ^10.0 || ^11.0 || ^12.0 || ^13.0
illuminate/validation Version ^10.0 || ^11.0 || ^12.0 || ^13.0
laravel/serializable-closure Version ^1.3|^2.0
spatie/simple-excel Version ^3.2