Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/ferchault/iago

Implicit Archiver for Generated Observables
https://github.com/ferchault/iago

Last synced: 26 days ago
JSON representation

Implicit Archiver for Generated Observables

Awesome Lists containing this project

README

        

.. image:: https://travis-ci.org/ferchault/iago.svg?branch=master
:target: https://travis-ci.org/ferchault/iago
.. image:: https://coveralls.io/repos/github/ferchault/iago/badge.svg?branch=master
:target: https://coveralls.io/github/ferchault/iago?branch=master

`Documentation `_

====
Supported Files and Services
====

================= ====================
Type Supported
================= ====================
Storage Local filesystem, SSH [1]_, Amazon S3 [2]_, Openstack Swift / Rackspace cloud files / Memset Memstore [2]_, Dropbox [2]_, Google Cloud Storage [2]_, Amazon Drive [2]_, Microsoft One Drive [2]_, Hubic [2]_, Backblaze B2 [2]_, Yandex Disk [2]_
================= ====================
.. [1] Requires `paramiko `_ to be installed.
.. [2] Requires `rclone `_ to be installed.
===========
Terminology
===========

================= ====================
Name Meaning
================= ====================
Run A single molecular dynamics (MD) run or single point calculation.
Bucket One set of runs that belong together. In particular, they share the physical system.
Frame Single configuration of the system. May be part of a time series (MD) or not (single point).
================= ====================
===================
Data Storage Levels
===================

In atomistic simulations, data can be related to different entities. iago deals with the following:

- Per bucket and run (e.g. configuration values)
- Per atom and bucket (e.g. atom kind, element, atom name)
- Per atom and frame (e.g. coordinates, velocities, forces)
- Per frame and bucket (e.g. total energy)
============
Config Files
============

There are two locations that hold configuration files: the analysis machine where a reference for the different locations is needed and the location remote where raw, aggregated and metadata is available. In any case, the file format follows the Windows INI files as implemented by the python module `ConfigParser `_.

----------------
Analysis Machine
----------------
This file holds the configuration options where to look for buckets on both local and remote machines. An example illustrates the supported protocols.

::

[localmachine]
url=file:///home/username/data/
[remoteserver]
url=ssh://username@hostname:/path
skip=True
[cloudstorage]
url=cloud://rcloneremotename:path

This file must reside in the user's home directory under the name *.iago.conf*.