Download the PHP package acdh-oeaw/arche-metadata-crawler without Composer

# Metadata Crawler

Functionality

A set of scripts:

• Merging metadata of a collection from inputs in various formats
• Validating the merged metadata
• Generating XLSX metadata templates based on the current ontology (see the horizontal metadata files in metadata formats description)

used for the metadata curation during ARCHE ingestions.

Installation

Locally

• Install PHP and composer
• Run:

As a docker image

• Install docker.

• Run the acdhch/arche-ingest image mounting your data directory into it:

• Run the scripts, e.g.

  and

  • if you need the file-checker, you can just run it with arche-filechecker

On ACDH Cluster

Nothing to be done. It is installed there already.

Usage

(For a full walk-trough using arche-ingestion@acdh-cluster and the Wollmilchsau test collection please look here)

On ACDH Cluster

First, get the arche-ingestion workload console as described here

Then:

• Generate and validate the metadata:

  • Run the arche-crawl-meta script:

  e.g.

  • If you are want to skip the checks (which speeds up the process significantly), add the --noCheck parameter, e.g.

• Create metadata templates:

  e.g. to create templates in the current directory

Locally

• Generating and validaing the metadata:

  e.g.

• Creating metadata templates:

  e.g. to create templates in the current directory

Remarks:

• To get a list of all available parameters run:

As a docker container

• Generating and validaing the metadata:
  Run a container mounting directory structure inside the container and overridding the command to be run with the arche-crawl-meta:

  e.g. to use with pahts relatively to the current working directory

• Creating metadata templates:
  Run a container mounting directory where templates should be created under /mnt inside the container and overridding the command to be run with the arche-create-metadata-template:

  e.g. to create the templates in the current directory