Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/nqn/mesos-chapel
Cray Chapel scheduler for Apache Mesos
https://github.com/nqn/mesos-chapel
Last synced: about 1 month ago
JSON representation
Cray Chapel scheduler for Apache Mesos
- Host: GitHub
- URL: https://github.com/nqn/mesos-chapel
- Owner: nqn
- License: apache-2.0
- Archived: true
- Created: 2014-03-02T21:44:42.000Z (almost 11 years ago)
- Default Branch: master
- Last Pushed: 2014-03-03T01:08:20.000Z (almost 11 years ago)
- Last Synced: 2024-08-04T04:06:43.866Z (5 months ago)
- Language: Go
- Size: 188 KB
- Stars: 22
- Watchers: 4
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-mesos - Chapel Parallel Programming Language
README
Cray Chapel Mesos scheduler
========Mesos framework scheduler for running The Chapel Parallel Programming Language (http://chapel.cray.com).
Usage:$ ./bin/chapel -locales -master
This is still an experimental framework and any participation and feedback is appreciated.
## Installation on an Elastic Mesos Cluster
First off, go ahead and launch a cluster at http://elastic.mesosphere.io.
Then log into one of the master nodes.$ sudo aptitude install make g++ libprotobuf-dev mercurial golang mpich2
### Install Chapel scheduler
$ wget https://github.com/nqn/mesos-chapel/archive/master.zip
$ unzip master
$ cd mesos-chapel-master
$ export GOPATH=`pwd`
$ make### Install Cray Chapel
$ wget http://gasnet.lbl.gov/GASNet-1.22.0.tar.gz
$ tar -xvzf GASNet-1.22.0.tar.gz
$ cd GASNet-1.22.0/
$ ./configure
$ sudo make install
$ cd ../
$ wget http://downloads.sourceforge.net/project/chapel/chapel/1.8.0/chapel-1.8.0.tar.gz
$ tar -xvzf chapel-1.8.0.tar.gz
$ cd chapel-1.8.0
$ export CHPL_COMM=gasnet
$ make
$ echo 'export PATH=$PATH:~/chapel-1.8.0/bin/linux64/' >> ~/.bashrc
$ source ~/.bashrc### Compile sample chapel program
$ cd examples/programs
$ chpl jacobi.chpl -o jacobi
$ cp jacobi ~/mesos-chapel-master/
$ cp jacobi_real ~/mesos-chapel-master/
$ cd
### Upload assets to HDFS$ cd mesos-chapel-master
$ hadoop fs -mkdir hdfs://54.211.128.164/chapel/
$ hadoop fs -put chapel-bootstrap.tgz hdfs://54.211.128.164/chapel/chapel-bootstrap.tgz
$ hadoop fs -put jacobi_real hdfs://54.211.128.164/chapel/jacobi_real### Run sample program
$ ./bin/chapel -master ec2-54-81-226-236.compute-1.amazonaws.com:5050 -name-node hdfs://54.211.128.164 -locales 3 ./jacobi
I0303 01:03:45.841869 4199 sched.cpp:218] No credentials provided. Attempting to register without authentication
I0303 01:03:45.842119 4199 sched.cpp:230] Detecting new master
[ 1 / 3 ] Setting up locale..
[ 2 / 3 ] Setting up locale..
[ 3 / 3 ] Setting up locale..
Jacobi computation complete.
Delta is 9.92124e-06 (< epsilon = 1e-05)
# of iterations: 60