Download the PHP package sm9sh/imdb-parser without Composer
On this page you can find all versions of the php package sm9sh/imdb-parser. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
FAQ
Example:
In general, it is recommended to use always a project to download your libraries. In an application normally there is more than one library needed.
- Some hosting areas are not accessible by a terminal or SSH. Then it is not possible to use Composer.
- To use Composer is sometimes complicated. Especially for beginners.
- Composer needs much resources. Sometimes they are not available on a simple webspace.
- If you are using private repositories you don't need to share your credentials. You can set up everything on our site and then you provide a simple download link to your team member.
- Simplify your Composer build process. Use our own command line tool to download the vendor folder as binary. This makes your build process faster and you don't need to expose your credentials for private repositories.
Informations about the package imdb-parser
imdb-parser
Import and update IMDb title.basics and title.ratings in a local SQLite database.
Requirements and installation
Use PHP 8.2+ with cURL, zlib and PDO SQLite, SQLite 3.24.0+ and Composer. Verified on PHP 8.2.34, SQLite 3.53.4 and Doctrine DBAL 2.13.9. SQLite upsert requires SQLite 3.24.0.
On Windows, use Copy-Item config.php.example config.php. Review the config before import. No command creates a config automatically. The local composer.lock is ignored; a fresh install resolves the constraints in composer.json. Review dependency updates. DBAL 2 uses the abandoned doctrine/cache package; upgrading DBAL is a separate task.
This checkout provides PHP 8.2.34 in .tools/php-8.2/ and Composer in .tools/composer.phar. These tools are ignored. For a fresh Windows checkout, install PHP 8.2 and Composer, or put them on PATH. run.bat selects the local runtime when available.
Use PHP 8.2 on PATH for generic php and composer commands. Set the PhpStorm CLI interpreter to .tools/php-8.2/php.exe and language level to 8.2.
Configuration and commands
DATABASE_URL defaults to db/imdb.sqlite. SQLite creates the directory, file, title table and indexes only for database actions. DOWNLOAD_DIR may contain spaces and need not end with a slash. Relative download paths resolve from the project directory.
TRANSACTION_PORTION is a positive integer (default 2000 data rows). CONNECT_TIMEOUT and TRANSFER_TIMEOUT are positive seconds (10 and 3600). DOWNLOAD_RETRIES is 0–5 (default 2 retries after the first attempt). DATASET_BASE_URL defaults to IMDb; it supports an HTTP(S) mirror without credentials.
| Command | Action |
|---|---|
php run.php --help |
Show help without config, database or file changes. No arguments do the same. |
php run.php -d |
Download and validate both gzip files; no database access. |
php run.php -u |
Extract both local gzip files; no database access. |
php run.php -p |
Validate both TSV headers, then import basics and update ratings. |
php run.php -a |
Download, extract and import; keep existing titles. |
php run.php -t |
Explicitly clear the title table. This deletes local title data. |
Flags may be combined, for example -u -p. -a never implies -t. File/header checks precede clearing when -p is present. Each file is replaced separately: an error on the second file can leave the first successfully replaced.
The project lock prevents two CLI processes in the same checkout from changing shared files. It does not coordinate different hosts or checkouts. Close other SQLite writers before import or backup.
Data, failures and schema
The importer preserves literal quotes, UTF-8, long titles and empty trailing fields. \N becomes SQL NULL. Years use integers, including 1894; missing numeric fields and ratings stay NULL. Invalid headers, column counts, identifiers or numbers stop the import and report the file and line.
Basics uses upsert by tconst; the last duplicate wins. Records absent from a later dataset remain in the database. Basics leaves ratings intact. Ratings update existing titles; unmatched rows are counted and do not create incomplete titles. updated uses the database's CURRENT_TIMESTAMP (UTC in SQLite).
Each committed transaction remains saved. A failure rolls back the current transaction; it does not undo earlier batches or the completed basics import. Fix the input or environment, then repeat -p from the start. No resume checkpoint is required. Exit 0 means success; errors use stderr and exit 1. Summaries show processed/committed rows, unmatched ratings, data SQL statement count, elapsed time and PHP peak memory.
Downloads use timeouts and retry temporary network/HTTP failures. Download and extraction write separate temporary files and validate gzip content, checksum and trailer before replacing the destination. Failed transfers preserve the previous destination and attempt to clean up temporary files. If the OS blocks deletion, a .part file can remain without a residual-path diagnostic; inspect the download directory after a failed operation. Single-member gzip streams are supported.
The existing SQLite schema is retained. An incompatible table fails before import; CREATE TABLE IF NOT EXISTS does not migrate it. No column migration was required for this release. To change an incompatible schema, stop all database users, back up the complete SQLite database, and apply a separately reviewed migration. Do not use -t as a migration.
MySQL remains a legacy backend via DATABASE_URL and PDO MySQL. Its old schema has year, title-length and nullable-field restrictions. This completion plan verifies SQLite; do not treat MySQL as validated for current datasets.
Tests and measurements
Tests use explicit assertions, their own temporary SQLite files and a local HTTP fixture. They do not load your config, use MySQL or contact IMDb. No coverage threshold is set. The suite covers parsing, duplicate updates, unmatched ratings, transaction failure/retry, CLI side effects/locking, timeout, HTTP errors and corrupted gzip. Benchmark databases are disposable. See measured results.
IMDb datasets are for personal/non-commercial use, subject to IMDb's terms and dataset specification.
