https://github.com/opendatamonitor/ckanext-harmonisation

Tool for harmonising metadata labels and values
https://github.com/opendatamonitor/ckanext-harmonisation

Last synced: about 2 months ago
JSON representation

Tool for harmonising metadata labels and values

• Host: GitHub
• URL: https://github.com/opendatamonitor/ckanext-harmonisation
• Owner: opendatamonitor
• Created: 2015-04-23T12:36:52.000Z (over 9 years ago)
• Default Branch: master
• Last Pushed: 2021-06-01T21:44:30.000Z (over 3 years ago)
• Last Synced: 2024-04-22T02:15:10.911Z (5 months ago)
• Language: Python
• Size: 252 KB
• Stars: 3
• Watchers: 5
• Forks: 1
• Open Issues: 3
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-starred - opendatamonitor/ckanext-harmonisation - Tool for harmonising metadata labels and values (others)

README

        
ckanext-harmonisation

======================

A tool for harmonising metadata labels and values.

Tested with CKAN v2.2 (http://docs.ckan.org/en/ckan-2.2/).

General

--------

The ckanext-harmonisation plugin harmonises metadata labels and values that comply with the ODM metadata scheme.

The plugin uses the mongo DB as metadata repository and developed as part of the ODM project (www.opendatamonitor.eu).

In order to use it, the collected metadata, raw and harmonised, need to be stored in collections with names as **odm** and **odm_harmonised** respectively.

Implementation

---------------

The extension gives the ability to an end user to harmonise specific metadata fields (Dates,Resources,Licenses,Categories) via a web form. It also provides the ability to add new mappings or update existing ones. 

Building

---------

In order to use this extension you need to have MongoDB installed.

To build and use this plugin, simply:

    git clone https://github.com/opendatamonitor/ckanext-harmonisation.git

    cd ckanext-harmonisation

    pip install -r requirements.txt

    python setup.py develop

Then you will need to update your CKAN configuration to include the new harvester.  This will mean adding the

ckanext-genericapiharvest plugin as a plugin.  E.g.

    ckan.plugins = harmonisation

Also you need to add the odm_extension settings to the development.ini file in your ckan folder.  

    [ckan:odm_extensions]

    mongoclient=localhost

    mongoport=27017

    log_path=/var/local/ckan/default/pyenv/src/

Using

---------

After setting this up, you should be able to go to:

    http://localhost:5000/harmonisation

In order to execute the scheduled harmonisation jobs you need to execute the harmonisation_slave.py. This script can be found in the ckanext-harmonisation plugin under **controllers** folder. For instance, if you have installed the CKAN under the /var/local/ckan/default/pyenv virtualenv folder, you can add the following cron job to run it automatically:

    30 * * * * *    /usr/bin/flock -n /tmp/slave.lockfile /var/local/ckan/default/pyenv/bin/python /var/local/ckan/default/pyenv/src/ckanext-harmonisation/ckanext/harmonisation/controllers/harmonisation_slave.py > /tmp/cronslave.log 2>&1

Licence

---------

This work is licensed under the GNU Affero General Public License (AGPL) v3.0 (http://www.fsf.org/licensing/licenses/agpl-3.0.html).