Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/arunk2/awesome-data-preservation

awesome-data-preservation
https://github.com/arunk2/awesome-data-preservation

List: awesome-data-preservation

Last synced: 16 days ago
JSON representation

awesome-data-preservation

Awesome Lists containing this project

README 

        
# Awesome Data Preservation ![Awesome](https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg)



A curated list of data preservation resources, inspired by [awesome-deep-vision](https://github.com/kjw0612/awesome-deep-vision) and [awesome-computer-vision](https://github.com/jbhuang0604/awesome-computer-vision).



Maintainers - [Arun kumar](https://github.com/arunk2)



## Contributing

Please feel free to [pull requests](https://github.com/arunk2/awesome-data-preservation/pulls) to add resources.



## Table of Contents

- [Important Papers & Reports](#papersreports)

- [Conferences](#conferences)

- [Active Communities](#activecommunities)

- [Books](#books)

- [Software](#softwaretools)



## PapersReports

- Digital Preservation Handbook, 2nd Edition. [PDF](http://handbook.dpconline.org/)



- Ensuring the Longevity of Digital Documents. **Author:** Rothenberg, Jeff. 

  `Published @ January 1995 edition of Scientific American (Vol. 272, Number 1, pp. 42-7)` [PDF](https://www.clir.org/pubs/archives/ensuring.pdf)



- Avoiding Technological Quicksand: Finding a Viable Technical Foundation for Digital Preservation. **Author:** Rothenberg, Jeff `Published report as ISBN 1-887334-63-7 in 1999` [PDF](https://www.clir.org/pubs/reports/rothenberg/pub77.pdf)



- Long Term Preservation of Digital Information. **Author:** Raymond A. Lorie, IBM Almaden Research Center 

  `Published @ JCDL '01 Proceedings of the 1st ACM/IEEE-CS joint conference on Digital libraries. Pages 346-352` [PDF](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.539.2669&rep=rep1&type=pdf)



- UVC: A Universal Virtual Computer for Long-term Preservation of Digital Information. **Authors:** Raymond A. Lorie; Raymond J. van Diessen

  `Published as IBM Researc Report: RJ10338 in 2005` [PDF](http://domino.research.ibm.com/library/cyberdig.nsf/papers/10229B6DE0D054C585256FA900681995/$File/rj10338.pdf)



- Permanent Web Publishing - LOCKSS (Lots Of Copies Keep Stuff Safe). **Authors:** David S.H. Rosenthal and Vicky Reich

  `In Proceedings of the FREENIX Track: 2000 USENIX Annual Technical Conference. June 18-23, 2000, San Diego, California. pp. 129-140` [PDF](https://lockss.org/locksswiki/files/Freenix2000.pdf)



- Emulation for Digital Preservation in Practice: The Results. **Authors:** Jeffrey van der Hoeven and Bram Lohman 

  `In Proceedings of the International Journal of Digital Curation. Dec 2007` [PDF](http://www.ijdc.net/index.php/ijdc/article/view/50/35)

 

- REFERENCE MODEL FOR AN OPEN ARCHIVAL INFORMATION SYSTEM (OAIS). 

  `The Consultative Committee for Space Data Systems (CCSDS) RECOMMENDED PRACTICE, MAGENTA BOOK, June 2012` [PDF](https://public.ccsds.org/pubs/650x0m2.pdf)



## Conferences

- [Joint Conference on Digital Libraries (JCDL)](http://jcdl.org/)



- [International Conference on Theory and Practice of Digital Libraries (TPDL)](http://www.tpdl.eu/)



- [Digital Library Feredaration (DLF)](https://www.diglib.org/)



- [Museum and Computer Network (MCN)](http://mcn.edu/)



- [International Council for Science : Committee on Data for Science and Technology (CODATA)](http://www.codata.org/)



- [Texas Conference on Digital Libraries (TCDL)](https://www.tdl.org/tcdl)



## ActiveCommunities

- [Open Preservation Foundation](http://openpreservation.org/)



- [Digital Preservation Coalition](http://www.dpconline.org/)



- [Digital Preservation Network](http://dpn.org/)



- [International Internet Preservation Consortium](http://netpreserve.org/)



- [Digital Preservation](http://digitalpreservation.gov/)



- [Digital Curation](http://www.dcc.ac.uk/)



## Books

- [Digital Preservation Handbook, 2nd Edition](http://handbook.dpconline.org/)



- [Digital Preservation for Libraries, Archives, and Museums 2nd Edition. Authors: Edward M. Corrado, Heather Moulaison Sandy](https://www.amazon.com/Digital-Preservation-Libraries-Archives-Museums/dp/1442278722/ref=sr_1_1?ie=UTF8&qid=1510125144&sr=8-1&keywords=digital+preservation+for+libraries%2C+archives%2C+and+museums&dpID=51IYn-fQR7L&preST=_SY291_BO1,204,203,200_QL40_&dpSrc=srch)



- [Preserving Local Writers, Genealogy, Photographs, Newspapers, and Related Materials. Authors: Carol Smallwood, Elaine Williams](https://www.amazon.com/Preserving-Genealogy-Photographs-Newspapers-Materials-ebook/dp/B007WUOFSO/ref=sr_1_12?ie=UTF8&qid=1510125144&sr=8-12&keywords=digital+preservation+for+libraries%2C+archives%2C+and+museums)



- [Metadata for Digital Collections: A How-to-Do-It Manual (How-To-Do-It Manual Series (for Librarians)). Author: Steven J. Miller](https://www.amazon.com/Metadata-Digital-Collections-How-Do/dp/1555707467/ref=pd_bxgy_14_img_2?_encoding=UTF8&psc=1&refRID=F46GJQFNKX2F95MSKV74)



- [Developing and Maintaining Practical Archives: A How-To-Do-It Manual (How-To-Do-It Manuals for Libraries) 2nd Edition. Author: Gregory S. Hunter](https://www.amazon.com/Developing-Maintaining-Practical-Archives-How/dp/1555704670/ref=pd_sim_14_4?_encoding=UTF8&psc=1&refRID=F46GJQFNKX2F95MSKV74)



## SoftwareTools



### Archivematica

Archivematica is a web- and standards-based, open-source application which allows your institution to preserve long-term access to trustworthy, authentic and reliable digital content [more...](https://www.archivematica.org/en/)



### POWRR

Preserving digital Objects With Restricted Resources (Digital POWRR) Project has endeavored to make digital preservation more accessible to a wider range of professionals [more...](http://digitalpowrr.niu.edu/)



### Format Identification for Digital Objects (fido)

Format Identification for Digital Objects (fido). fido is a command-line tool to identify the file formats of digital objects. It is designed for simple integration into automated work-flows [more...](http://openpreservation.org/technology/products/fido/)



### JHOVE

JHOVE (pronounced “jove”), the JSTOR/Harvard Object Validation Environment, is an extensible software framework for performing format identification, validation, and characterisation of digital objects. The OPF have assumed active responsibility for the project and software creating a permanent, sustainable home for JHOVE [more...](http://jhove.openpreservation.org/)



### Jpylyzer

About Jpylyzer is a JP2 (JPEG 2000 Part 1) image validator and properties extractor. Its development was partially supported by the SCAPE Project. The SCAPE project is co-funded by the European Union under FP7 ICT-2009.4.1 (Grant Agreement number 270137) [more...](http://openplanets.github.io/jpylyzer/)



### xcorrSound

Improve Your Digital Audio Recordings What is xcorrSound? xcorrSound consists of four tools: overlap-analysis detects overlap in two audio files waveform-compare compares two audio files and outputs the similarity sound-match detects occurrences of a smaller audio file (e.g. a jingle) within a larger audio file or an index of audio files sound-index builds an index [more...](http://openpreservation.org/technology/products/xcorrsound/)



### DROID

DROID is a software tool developed by The National Archives to perform automated batch identification of file formats. Developed by its Digital Preservation Department as part of its broader digital preservation activities, DROID is designed to meet the fundamental requirement of any digital repository to be able to identify the precise format of all stored digital objects, and to link that identification to a central registry of technical information about that format and its dependencies [more...](https://github.com/digital-preservation/droid)



### CSV Validator

A Validation Tool and APIs for validating CSV (Comma Separated Value) files by using CSV Schema [more...](https://github.com/digital-preservation/csv-validator)



### UTF-8 Validator

A UTF-8 Validation Tool which may be used as either a command line tool or as a library embedded in your own program [more...](https://github.com/digital-preservation/utf8-validator)



### format-corpus

An openly-licensed corpus of small example files, covering a wide range of formats and creation tools [more...](https://github.com/openpreserve/format-corpus)



### Bitwiser

This is a small suite of tools used to perform bitwise analysis of data and processes related to digital preservation [more...](https://github.com/openpreserve/bitwiser)