Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/sandialabs/faodel

Flexible, Asynchronous, Object Data-Exchange Libraries: HPC libraries for moving data between applications
https://github.com/sandialabs/faodel

scr-2301 snl-data-analysis snl-os-sys-software snl-performance

Last synced: 2 days ago
JSON representation

Flexible, Asynchronous, Object Data-Exchange Libraries: HPC libraries for moving data between applications

Awesome Lists containing this project

README 

        
FAODEL Overview

===============

FAODEL (Flexible, Asynchronous, Object Data-Exchange Libraries) is a 

collection of software libraries that are used to implement 

different data management services on high-performance computing (HPC)

platforms. This project was funded through NNSA's ASC program at Sandia 

National Laboratories.



- **What Problem Does This Solve?** HPC workflows often need a way to

  move large datasets between two or more MPI applications. Rather than route

  intermediate data through the filesystem, FAODEL lets you pass the data

  *directly* between the two MPI applications or *indirectly* through a 

  separate distributed memory application. The filesystem can also be used

  if applications in the workflow do not run concurrently.

  

- **Who Is the Intended Audience?** This software is intended for HPC 

  developers that write parallel MPI applications in C++ and run 

  workflows on cluster computers with hundreds to thousands of compute

  nodes. FAODEL requires an HPC network fabric such as InfiniBand, RoCE,

  OmniPath, or Gemini.



- **Pronounciation**: We say *"Fay-oh-Dell"*.

 

**Note**: FAODEL development takes place in a private repository due to Sandia's

      software release process. The Github repository is only updated when

      there are minor bug fixes or new release snapshots. This message will

      be updated if/when FAODEL is no longer being developed.



Components

----------

FAODEL is composed of multiple libraries:



- [Kelpie](src/kelpie/README_Kelpie.md): Kelpie is a distributed memory

  service that enables applications to migrate different data objects

  between compute nodes in a platform. It utilizes out-of-band RDMA

  communication to enable different MPI jobs to interact with each

  other.

- [DirMan](src/dirman/README_DirMan.md): DirMan is a service for 

  managing runtime information (e.g., a list of nodes that make up

  a pool for storing data).

- [OpBox](src/opbox/README_OpBox.md): OpBox is a communication engine

  responsible for orchestrating complex communication patterns in a

  distributed system. Rather than use traditional remote-procedure

  call (RPC) techniques, communication is facilitated through state

  machines called Ops. Ops allow distributed protocols to run

  asynchronously, without explicit maintenance by user services.

- [Lunasa](src/lunasa/README_Lunasa.md): Lunasa is a memory management unit

  for data that may be transmitted on the network using RDMAs. In

  order to reduce network registration overheads, Lunasa allocates

  sizable amounts of registered memory and then suballocates it to

  applications through tcmalloc. User allocations are described by

  Lunasa Data Objects (LDOs), which provide reference counting and

  object description in the stack.

- [NNTI](src/nnti/README_NNTI.md): NNTI is a low-level, RDMA portability

  layer for high-performance networks. It provides application with

  the ability to send messages and coordinate RDMA transfers via

  registered memory.

- [Whookie](src/whookie/README_Whookie.md): Whookie is a network service for

  FAODEL nodes that enables users and applications to query

  and change the state of a node via an HTTP connection.

- [Services](src/faodel-services/README_Services.md): Basic services that make it

  easier to write communication applications.  

- [Common](src/faodel-common/README_Common.md): Common is a collection of data types

  and software functions that are used throughout FAODEL.

- [SBL](src/sbl/README_SBL.md): The Simplified Boost Logging (SBL) library

  provides a way to map log information in FAODEL components to

  Boost's logging library.

  

There are two main command-line tools users may find useful:



- [faodel-cli](tools/faodel-cli/README_Faodel_Cli.md): This tool is an 

  all-in-one tool for hosting and configuring different faodel services 

  such as dirman and kelpie. Users can obtain build and runtime info, as 

  well as query services and put/get/delete objects. Commands can also be

  replayed through the play command. 

- [faodel-stress](tools/faodel-stress/README_Faodel_Stress.md): This

  standalone tool can be used to benchmark a system and estimate how

  well it performs different data management operations.



Additional Information

======================

This release includes files to help guide users. The files are:



- [INSTALL](INSTALL.md): Details about how to configure, build,

  install and run the software provided in this release. This document

  is a good starting point, as the build process can be challenging on

  different platforms.

- [LICENSE](LICENSE.md): The FAODEL code uses the MIT license.

- [NEWS](NEWS.md): The news file provides a history of major changes provided

  with each release of this software. Developers should review this document

  when switching to a new release.

- [Configuration File Cookbook](docs/ConfigurationFileCookbook.md): This page 

  provides a summary of runtime configuration settings to plug into your

  $FAODEL_CONFIG file

- [What's a Faodel?](docs/WhatsAFaodel.md) How we picked the acronym.



Contributors

============

The following developers contributed code to the FAODEL:



- Nathan Fabian

- Todd Kordenbrock

- Scott Levy

- Shyamali Mukherjee

- Gary Templet

- Craig Ulmer

- Patrick Widener



The following helped contribute ideas and provided feedback for the project:



- Margaret Lawson

- Jay Lofstead

- Ron Oldfield

- Jeremy Wilke



This release includes third-party software that contains its own licensing

and copyright info:

- cereal (in tpl/cereal)

- gperftools (in tpl/gperftools)

- Boost ASIO examples (in src/whookie/server)



Copyright

=========

Copyright 2021 National Technology & Engineering Solutions of Sandia, LLC

(NTESS). Under the terms of Contract DE-NA0003525 with NTESS, the U.S. 

Government retains certain rights in this software.