Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/githubfoam/openhpc-sandbox
openhpc
https://github.com/githubfoam/openhpc-sandbox
benchmark high-performance-computing high-throughput-computing hpc-cluster pipeline
Last synced: 23 days ago
JSON representation
openhpc
- Host: GitHub
- URL: https://github.com/githubfoam/openhpc-sandbox
- Owner: githubfoam
- License: gpl-3.0
- Created: 2020-05-03T08:29:04.000Z (over 4 years ago)
- Default Branch: master
- Last Pushed: 2020-09-16T21:48:33.000Z (over 4 years ago)
- Last Synced: 2023-03-05T19:43:54.838Z (almost 2 years ago)
- Topics: benchmark, high-performance-computing, high-throughput-computing, hpc-cluster, pipeline
- Language: Shell
- Size: 14.4 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# openhpc-sandbox
[](https://travis-ci.com/githubfoam/openhpc-sandbox)
nodes(booted together, not sequential)
~~~~
master01
eth0 : public
eth1 : private
compute01
eth0 : public
eth1 : private (MAC)
compute02
eth0 : public
eth1 : private (MAC)
~~~~
~~~~
installer user: vagrant
passwordless ssh between all nodes
~~~~
~~~~
ROOT MUST BE (not vagrant)
# initialize PBS path
. /etc/profile.d/pbs.sh
# enable user environment propagation (needed for modules support)
qmgr -c "set server default_qsub_arguments= -V"
# enable uniform multi-node MPI task distribution
qmgr -c "set server resources_default.place=scatter"
# enable support for job accounting
qmgr -c "set server job_history_enable=True"
# register compute hosts with pbspro
~~~~
~~~~
[vagrant@master01 groups.d]$ wwsh file list
dynamic_hosts : rw-r--r-- 0 root root 688 /etc/hosts
group : rw-r--r-- 1 root root 679 /etc/group
network : rw-r--r-- 1 root vagrant 16 /etc/sysconfig/network
passwd : rw-r--r-- 1 root root 1590 /etc/passwd
shadow : rw-r----- 1 root root 983 /etc/shadow
[vagrant@master01 groups.d]$ wwsh node list
NAME GROUPS IPADDR HWADDR
================================================================================
compute01 UNDEF 192.168.1.253 08:00:27:e3:b0:01
compute02 UNDEF 192.168.1.252 08:00:27:77:86:f5
[vagrant@master01 groups.d]$ sudo wwsh provision list
NODE VNFS BOOTSTRAP FILES
================================================================================
compute01 centos7.6 3.10.0-957.1.3.el7... dynamic_hosts,grou...
compute02 centos7.6 3.10.0-957.1.3.el7... dynamic_hosts,grou...
[vagrant@master01 ~]$ pdsh -w compute0[1-2] uptime
compute01: 13:42:52 up 23 min, 0 users, load average: 0.00, 0.01, 0.03
compute02: 13:42:52 up 3:25, 2 users, load average: 0.00, 0.01, 0.05
[vagrant@master01 ~]$ wwsh vnfs list
VNFS NAME SIZE (M) ARCH CHROOT LOCATION
centos7.6 279.8 x86_64 /opt/ohpc/admin/images/centos7.6
[vagrant@master01 ~]$ pbsnodes -a
compute01
Mom = compute01.localdomain
ntype = PBS
state = state-unknown,down
pcpus = 1
resources_available.host = compute01
resources_available.ncpus = 1
resources_available.vnode = compute01
resources_assigned.accelerator_memory = 0kb
resources_assigned.hbmem = 0kb
resources_assigned.mem = 0kb
resources_assigned.naccelerators = 0
resources_assigned.ncpus = 0
resources_assigned.vmem = 0kb
comment = node down: communication closed
resv_enable = True
sharing = default_shared
last_state_change_time = Sun Jul 28 11:40:41 2019
compute02
Mom = compute02
ntype = PBS
state = state-unknown,down
pcpus = 1
resources_available.host = compute02
resources_available.ncpus = 1
resources_available.vnode = compute02
resources_assigned.accelerator_memory = 0kb
resources_assigned.hbmem = 0kb
resources_assigned.mem = 0kb
resources_assigned.naccelerators = 0
resources_assigned.ncpus = 0
resources_assigned.vmem = 0kb
comment = node down: communication closed
resv_enable = True
sharing = default_shared
last_state_change_time = Sun Jul 28 11:40:41 2019
~~~~
OpenHPC 1.3.8
~~~~
Install guide with Warewulf + PBS Professional (PDF)
https://github.com/openhpc/ohpc/releases/download/v1.3.8.GA/Install_guide-CentOS7-Warewulf-PBSPro-1.3.8-x86_64.pdf
~~~~
~~~~
https://github.com/openhpc/ohpc
~~~~