https://github.com/dmlc/ps-lite

A lightweight parameter server interface
https://github.com/dmlc/ps-lite

Last synced: about 1 month ago
JSON representation

A lightweight parameter server interface

• Host: GitHub
• URL: https://github.com/dmlc/ps-lite
• Owner: dmlc
• License: apache-2.0
• Created: 2015-04-26T19:29:30.000Z (over 9 years ago)
• Default Branch: master
• Last Pushed: 2023-01-11T05:35:49.000Z (almost 2 years ago)
• Last Synced: 2024-09-26T23:03:43.226Z (about 1 month ago)
• Language: C++
• Homepage: http://ps-lite.readthedocs.org
• Size: 897 KB
• Stars: 1,533
• Watchers: 90
• Forks: 542
• Open Issues: 73
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
[![Build Status](https://travis-ci.org/dmlc/ps-lite.svg?branch=master)](https://travis-ci.org/dmlc/ps-lite)

[![GitHub license](http://dmlc.github.io/img/apache2.svg)](./LICENSE)

A light and efficient implementation of the parameter server

framework. It provides clean yet powerful APIs. For example, a worker node can

communicate with the server nodes by

- `Push(keys, values)`: push a list of (key, value) pairs to the server nodes

- `Pull(keys)`: pull the values from servers for a list of keys

- `Wait`: wait untill a push or pull finished.

A simple example:

```c++

  std::vector key = {1, 3, 5};

  std::vector val = {1, 1, 1};

  std::vector recv_val;

  ps::KVWorker w;

  w.Wait(w.Push(key, val));

  w.Wait(w.Pull(key, &recv_val));

```

More features:

- Flexible and high-performance communication: zero-copy push/pull, supporting

  dynamic length values, user-defined filters for communication compression

- Server-side programming: supporting user-defined handles on server nodes

### Build

`ps-lite` requires a C++11 compiler such as `g++ >= 4.8`. On Ubuntu >= 13.10, we

can install it by

```

sudo apt-get update && sudo apt-get install -y build-essential git

```

Instructions for gcc 4.8 installation on other platforms:

- [Ubuntu 12.04](http://ubuntuhandbook.org/index.php/2013/08/install-gcc-4-8-via-ppa-in-ubuntu-12-04-13-04/)

- [Centos](http://linux.web.cern.ch/linux/devtoolset/)

- [Mac Os X](http://hpc.sourceforge.net/).

Then clone and build

```bash

git clone https://github.com/dmlc/ps-lite

cd ps-lite && make -j4

```

### How to use

`ps-lite` provides asynchronous communication for other projects: 

  - Distributed deep neural networks:

    [MXNet](https://github.com/dmlc/mxnet),

    [CXXNET](https://github.com/dmlc/cxxnet),

    [Minverva](https://github.com/minerva-developers/minerva), and

    [BytePS](https://github.com/bytedance/byteps/)

  - Distributed high dimensional inference, such as sparse logistic regression,

    factorization machines:

    [DiFacto](https://github.com/dmlc/difacto)

    [Wormhole](https://github.com/dmlc/wormhole)

### Research papers

  1. Mu Li, Dave Andersen, Alex Smola, Junwoo Park, Amr Ahmed, Vanja Josifovski,

     James Long, Eugene Shekita, Bor-Yiing

     Su. [Scaling Distributed Machine Learning with the Parameter Server](http://www.cs.cmu.edu/~muli/file/parameter_server_osdi14.pdf). In

     Operating Systems Design and Implementation (OSDI), 2014

  2. Mu Li, Dave Andersen, Alex Smola, and Kai

     Yu. [Communication Efficient Distributed Machine Learning with the Parameter Server](http://www.cs.cmu.edu/~muli/file/parameter_server_nips14.pdf). In

     Neural Information Processing Systems (NIPS), 2014