https://github.com/digibib/ls.etl
Project housing various etl scritps to populate koha
https://github.com/digibib/ls.etl
Last synced: 7 months ago
JSON representation
Project housing various etl scritps to populate koha
- Host: GitHub
- URL: https://github.com/digibib/ls.etl
- Owner: digibib
- License: mit
- Archived: true
- Created: 2014-11-06T15:25:22.000Z (over 11 years ago)
- Default Branch: master
- Last Pushed: 2014-11-10T10:07:27.000Z (over 11 years ago)
- Last Synced: 2025-03-06T09:48:46.405Z (over 1 year ago)
- Language: Python
- Size: 176 KB
- Stars: 1
- Watchers: 16
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# LS.ETL
Load of example-data (test-data for manual user-testing) into ls.ext
Koha needs the following entities:
- branch
- item type
- patron category
- (item statuses) authorised values
- circulation rules
- bibliographic data
- item data
- patron
## Process:
- Prepare or extract example data from source.
- If necessary transform example data. Use e.g. Catmandu importer
- Load (transformed) example data into Koha.
- Test that koha is in a legal state.
### Typcial scenario:
A csv-file is created manually, the file is input to a load-script that
utilizes importers in Catmandu to transform csv-records to json, which is
finally loaded into koha by posting them to the koha-restful api.
## EXTRACT
Is accomplished either as
* a manually created (csv) file,
* custom jobs to dump records to file, or
* as a first step in the LOAD-job.
## TRANSFORM
Is often done as a step in the LOAD-job.
## LOAD
We utilize the import-functions in Koha to get the data into it. In general
there are three mechanisms to support this:
* by api,
* by SQL,
* by HTML.
We prefer loading by api.
Mapping of entities to import-function in Koha:
Entity | Mechanism | Name
------ | --------- | ----
branch | api | koha-restful/Branch.pm
## ETL-software (opensource):
* [LibreCat/Catmandu](http://librecat.org/)