https://github.com/nqn/mesos-chapel

Cray Chapel scheduler for Apache Mesos
https://github.com/nqn/mesos-chapel

Last synced: 1 day ago
JSON representation

Cray Chapel scheduler for Apache Mesos

• Host: GitHub
• URL: https://github.com/nqn/mesos-chapel
• Owner: nqn
• License: apache-2.0
• Archived: true
• Created: 2014-03-02T21:44:42.000Z (over 10 years ago)
• Default Branch: master
• Last Pushed: 2014-03-03T01:08:20.000Z (over 10 years ago)
• Last Synced: 2024-08-04T04:06:43.866Z (3 months ago)
• Language: Go
• Size: 188 KB
• Stars: 22
• Watchers: 4
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-mesos - Chapel Parallel Programming Language

README

        
Cray Chapel Mesos scheduler

========

Mesos framework scheduler for running The Chapel Parallel Programming Language (http://chapel.cray.com).

Usage:

    $ ./bin/chapel -locales  -master  

This is still an experimental framework and any participation and feedback is appreciated.

## Installation on an Elastic Mesos Cluster

First off, go ahead and launch a cluster at http://elastic.mesosphere.io.

Then log into one of the master nodes.

    $ sudo aptitude install make g++ libprotobuf-dev mercurial golang mpich2

### Install Chapel scheduler

    $ wget https://github.com/nqn/mesos-chapel/archive/master.zip

    $ unzip master

    $ cd mesos-chapel-master

    $ export GOPATH=`pwd`

    $ make

### Install Cray Chapel

    $ wget http://gasnet.lbl.gov/GASNet-1.22.0.tar.gz

    $ tar -xvzf GASNet-1.22.0.tar.gz

    $ cd GASNet-1.22.0/

    $ ./configure

    $ sudo make install

    $ cd ../

    $ wget http://downloads.sourceforge.net/project/chapel/chapel/1.8.0/chapel-1.8.0.tar.gz

    $ tar -xvzf chapel-1.8.0.tar.gz

    $ cd chapel-1.8.0

    $ export CHPL_COMM=gasnet

    $ make

    $ echo 'export PATH=$PATH:~/chapel-1.8.0/bin/linux64/' >> ~/.bashrc

    $ source ~/.bashrc

### Compile sample chapel program

    $ cd examples/programs

    $ chpl jacobi.chpl -o jacobi

    $ cp jacobi ~/mesos-chapel-master/

    $ cp jacobi_real ~/mesos-chapel-master/

    $ cd

    

### Upload assets to HDFS

    $ cd mesos-chapel-master

    $ hadoop fs -mkdir hdfs://54.211.128.164/chapel/

    $ hadoop fs -put chapel-bootstrap.tgz hdfs://54.211.128.164/chapel/chapel-bootstrap.tgz

    $ hadoop fs -put jacobi_real hdfs://54.211.128.164/chapel/jacobi_real

### Run sample program

    $ ./bin/chapel -master ec2-54-81-226-236.compute-1.amazonaws.com:5050 -name-node hdfs://54.211.128.164 -locales 3 ./jacobi

    I0303 01:03:45.841869  4199 sched.cpp:218] No credentials provided. Attempting to register without authentication

    I0303 01:03:45.842119  4199 sched.cpp:230] Detecting new master

    [ 1 / 3 ] Setting up locale..

    [ 2 / 3 ] Setting up locale..

    [ 3 / 3 ] Setting up locale..

    Jacobi computation complete.

    Delta is 9.92124e-06 (< epsilon = 1e-05)

    # of iterations: 60