https://github.com/mnylc/islandora_multi_importer

This is a flexible, twig based, all cmodel, tabular data to islandora Object importer with optional ZeroMQ processing
https://github.com/mnylc/islandora_multi_importer

Last synced: 3 months ago
JSON representation

This is a flexible, twig based, all cmodel, tabular data to islandora Object importer with optional ZeroMQ processing

• Host: GitHub
• URL: https://github.com/mnylc/islandora_multi_importer
• Owner: mnylc
• License: gpl-3.0
• Created: 2016-01-28T21:08:13.000Z (almost 9 years ago)
• Default Branch: master
• Last Pushed: 2020-11-29T23:45:31.000Z (almost 4 years ago)
• Last Synced: 2024-05-02T21:07:27.643Z (7 months ago)
• Language: PHP
• Homepage:
• Size: 903 KB
• Stars: 16
• Watchers: 13
• Forks: 16
• Open Issues: 38
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• islandora_awesome - Islandora Multi Importer - Allows for ingesting metadata and datastreams from a CSV. Metadata can be transformed to XML from CSV fields using custom Twig templates, and datastreams can be paths to local files or URLs, which allows for ingesting remote content. (The Islandora 7.x-1.x List / Utility Modules)

README

        
# islandora_multi_importer

### DCMNY admin documentation 

[Multi-Importer Admin Instructions for DCMNY Administrators] (https://docs.google.com/document/d/18oB6sX-8s6sIScgUf7RbkFFlJ52Y9k_f9FcsaWvDJ7s/edit?usp=sharing)

[Sample CSV (configured for multi-importer ingest)] (https://drive.google.com/file/d/0BzuVASmQStk8dWJ6UGt6bmphcGs/view?usp=sharing)

[DCMNY Metadata Spreadsheet (for use with multi-importer ingest)] (https://docs.google.com/spreadsheets/d/1fL9oO_x35tUx3wKSZ4a848ravc4Oh1Wjk5ykU3H1Ti8/edit?usp=sharing)

### Installation 

* Ensure that [composer](https://getcomposer.org/doc/00-intro.md#installation-linux-unix-osx) is installed in your enviornment: ```composer version```.  

* Clone the module into the modules folder: ```git clone https://github.com/mnylc/islandora_multi_importer```

* Install the module's dependency using the composer ```composer install```

* Ensure that you have all the module's drupal dependencies (ex [Field Group](https://www.drupal.org/project/field_group))

* Enable the module

### Twig

[Sample Twig Templates (for use with multi-importer ingest)] (https://github.com/mnylc/dcmny/tree/master/twig)

[Twig Documentation] (http://twig.sensiolabs.org/documentation)

### Why Use Multi-importer

* UI driven integrated workflow for ingest and update

* Metadata Cleanup: Export your MODS metadata as CSV via Solr, clean up, then update the MODS datastream of the objects by recreating the MODS datastream using Twig

* To ingest different content types at the same time including hierarchies, like collections inside collections with compounds and books, etc

* To avoid having to follow strict naming conventions and folder structure dictated by many Islandora batch ingest processes

* Selectively choose which derivatives you want to create and upload

* To avoid the OpenRefine/XSLT approach to creating MODS from CSVs

* To take advantage of the Twig Templating system for creating MODS from CSVs

* To preview the MODS output easily

* Supports integration with Google Spreadsheets, Zip/Local/Amazon storage and Complex storage needs via hooks.

* Added Jasny Pcre Extension. Twig templates can now support regular expressions. Be mindful of needing doubly escaped backslashes in situations that require regex with backslashes.

### Updating existing Objects

* To enable this functionality without any warnings you need to use https://github.com/mnylc/islandora_batch/tree/7.x-ISLANDORA-2046 instead of main Islandora Batch release. We are working on making those changes into the main release.

* Objects (PIDs) present in other Batch Sets won't be able to be updated because Islandora Batch only allows a single PID to exist in its DB. We are working on fixing that inside 7.x-ISLANDORA-2046. For now, please delete old batch sets if you plan on updating existing Objects that were ingested using Islandora Batch.