Libraries tagged by large data
simplemage/module-category-product-indexer
781 Downloads
High-performance rewrite of Magento 2's catalog_category_product indexer using the snapshot pattern. Solves the classic 'Could not acquire lock' hang on large catalogs (500k+ products). 2.6x-7.7x faster measured on real production databases.
sendx/sendx-php-sdk
15307 Downloads
# SendX REST API Documentation ## ๐ Introduction The SendX API is organized around REST principles. Our API has predictable resource-oriented URLs, accepts JSON-encoded request bodies, returns JSON-encoded responses, and uses standard HTTP response codes, authentication, and verbs. **Key Features:** - ๐ **Security**: Team-based authentication with optional member-level access - ๐ฏ **Resource-Oriented**: RESTful design with clear resource boundaries - ๐ **Rich Data Models**: Three-layer model system (Input/Output/Internal) - ๐ **Relationships**: Automatic prefix handling for resource relationships - ๐ **Scalable**: Built for high-volume email marketing operations ## ๐๏ธ Architecture Overview SendX uses a three-layer model architecture: 1. **Input Models** (`RestE*`): For API requests 2. **Output Models** (`RestR*`): For API responses with prefixed IDs 3. **Internal Models**: Core business logic (not exposed in API) ## ๐ Security & Authentication SendX uses API key authentication: ### Team API Key ```http X-Team-ApiKey: YOUR_TEAM_API_KEY ``` - **Required for all requests** - Team-level access to resources - Available in SendX Settings โ Team API Key ## ๐ Encrypted ID System SendX uses encrypted IDs for security and better developer experience: - **Internal IDs**: Sequential integers (not exposed) - **Encrypted IDs**: 22-character alphanumeric strings - **Prefixed IDs**: Resource-type prefixes in API responses (`contact_`) ### ID Format **All resource IDs follow this pattern:** ``` _ ``` **Example:** ```json { "id": "contact_BnKjkbBBS500CoBCP0oChQ", "lists": ["list_OcuxJHdiAvujmwQVJfd3ss", "list_0tOFLp5RgV7s3LNiHrjGYs"], "tags": ["tag_UhsDkjL772Qbj5lWtT62VK", "tag_fL7t9lsnZ9swvx2HrtQ9wM"] } ``` ## ๐ Resource Prefixes | Resource | Prefix | Example | |----------|--------|---------| | Contact | `contact_` | `contact_BnKjkbBBS500CoBCP0oChQ` | | Campaign | `campaign_` | `campaign_LUE9BTxmksSmqHWbh96zsn` | | List | `list_` | `list_OcuxJHdiAvujmwQVJfd3ss` | | Tag | `tag_` | `tag_UhsDkjL772Qbj5lWtT62VK` | | Sender | `sender_` | `sender_4vK3WFhMgvOwUNyaL4QxCD` | | Template | `template_` | `template_f3lJvTEhSjKGVb5Lwc5SWS` | | Custom Field | `field_` | `field_MnuqBAG2NPLm7PZMWbjQxt` | | Webhook | `webhook_` | `webhook_9l154iiXlZoPo7vngmamee` | | Post | `post_` | `post_XyZ123aBc456DeF789GhI` | | Post Category | `post_category_` | `post_category_YzS1wOU20yw87UUHKxMzwn` | | Post Tag | `post_tag_` | `post_tag_123XyZ456AbC` | | Member | `member_` | `member_JkL012MnO345PqR678` | ## ๐ฏ Best Practices ### Error Handling - **Always check status codes**: 2xx = success, 4xx = client error, 5xx = server error - **Read error messages**: Descriptive messages help debug issues - **Handle rate limits**: Respect API rate limits for optimal performance ### Data Validation - **Email format**: Must be valid email addresses - **Required fields**: Check documentation for mandatory fields - **Field lengths**: Respect maximum length constraints ### Performance - **Pagination**: Use offset/limit for large datasets - **Batch operations**: Process multiple items when supported - **Caching**: Cache responses when appropriate ## ๐ ๏ธ SDKs & Integration Official SDKs available for: - [Golang](https://github.com/sendx/sendx-go-sdk) - [Python](https://github.com/sendx/sendx-python-sdk) - [Ruby](https://github.com/sendx/sendx-ruby-sdk) - [Java](https://github.com/sendx/sendx-java-sdk) - [PHP](https://github.com/sendx/sendx-php-sdk) - [JavaScript](https://github.com/sendx/sendx-javascript-sdk) ## ๐ Support Need help? Contact us: - ๐ฌ **Website Chat**: Available on sendx.io - ๐ง **Email**: [email protected] - ๐ **Documentation**: Full guides at help.sendx.io --- **API Endpoint:** `https://api.sendx.io/api/v1/rest` [](https://god.gw.postman.com/run-collection/33476323-44b198b0-5219-4619-a01f-cfc24d573885?action=collection%2Ffork&source=rip_markdown&collection-url=entityId%3D33476323-44b198b0-5219-4619-a01f-cfc24d573885%26entityType%3Dcollection%26workspaceId%3D6b1e4f65-96a9-4136-9512-6266c852517e)
jfbiswajit/php-bigquery
9840 Downloads
PHP BigQuery for Laravel is a seamless integration package that allows you to harness the power of Google BigQuery in your Laravel applications effortlessly. With a zero-configuration setup, plug and play this library to perform high-speed querying and advanced analytics on large datasets.
andydefer/algo-kit
4345 Downloads
Algo KIT - Probabilistic data structures and algorithms for large-scale data processing in PHP
juampynr/syncdb
35186 Downloads
Import and export large Drupal databases faster using Drush.
imanghafoori/laravel-fast-refresh-database
675 Downloads
Quickly refresh your large database in tests.
isaacdew/load-data
314 Downloads
Fluent syntax for loading large CSV files into MySQL using LOAD DATA INFILE in Laravel.
dfware/csv-grid
301 Downloads
Yii2 extension data export to CSV file
bakhirev/assayo
567 Downloads
Visualization and analysis you git log. Creates HTML report about commits statistics, employees and company. Also it parse git log and give a achievements based on git stat. In addition the typical git stats, this package can show statistics by departments, tasks or determine the location of users. It quickly parses large git log files.
w3spi5/bigdump
2 Downloads
Staggered MySQL Dump Importer - Import large MySQL dumps on servers with execution time limits
leyton/clevexport
14 Downloads
A Clever mechanism to export large data asynchronously
jhhb01/silverstripe_ajax_dropdown
554 Downloads
Use Ajax in Dropdowns for large datasets
phpbb/titania
165 Downloads
This adds a very powerful and large customisation database to your forum. It is codenamed Titania.
askdkc/livewire-csv
1402 Downloads
Add importing large CSV (and TSV) data feature to your Laravel models quickly and easily / Laravelใซใๆ่ปฝใซCSVใคใณใใผใๆฉ่ฝ(TSVๅซใใใใคๅคงๅฎน้ๅฏพๅฟ)ใ่ฟฝๅ ใใๅใใใคใ ใ๐
mohamadtsn/laravel-fast-refresh-database
19 Downloads
Quickly refresh your large database in tests.