{"id":22748248,"url":"https://github.com/githubfoam/beegfs-sandbox","last_synced_at":"2025-04-12T22:41:56.817Z","repository":{"id":39886412,"uuid":"131566793","full_name":"githubfoam/beegfs-sandbox","owner":"githubfoam","description":"beegfs  HPC","archived":false,"fork":false,"pushed_at":"2020-09-23T20:05:21.000Z","size":45,"stargazers_count":3,"open_issues_count":2,"forks_count":2,"subscribers_count":0,"default_branch":"master","last_synced_at":"2025-03-26T16:48:58.838Z","etag":null,"topics":["beegfs","high-performance-computing","hpc","object-storage","parallel-cluster-filesystem","parallel-filesystem","pipeline","vagrant","zfs"],"latest_commit_sha":null,"homepage":"","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/githubfoam.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2018-04-30T07:20:22.000Z","updated_at":"2024-10-11T13:13:41.000Z","dependencies_parsed_at":"2022-07-31T23:48:16.312Z","dependency_job_id":null,"html_url":"https://github.com/githubfoam/beegfs-sandbox","commit_stats":null,"previous_names":[],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/githubfoam%2Fbeegfs-sandbox","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/githubfoam%2Fbeegfs-sandbox/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/githubfoam%2Fbeegfs-sandbox/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/githubfoam%2Fbeegfs-sandbox/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/githubfoam","download_url":"https://codeload.github.com/githubfoam/beegfs-sandbox/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248643045,"owners_count":21138353,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beegfs","high-performance-computing","hpc","object-storage","parallel-cluster-filesystem","parallel-filesystem","pipeline","vagrant","zfs"],"created_at":"2024-12-11T03:21:39.789Z","updated_at":"2025-04-12T22:41:56.793Z","avatar_url":"https://github.com/githubfoam.png","language":"HTML","readme":"# Beegfs Sandbox\n\nTravis (.com) branch:\n[![Build Status](https://travis-ci.com/githubfoam/beegfs-sandbox.svg?branch=master)](https://travis-ci.com/githubfoam/beegfs-sandbox)  \n\n```\n\u003evagrant up vg-mgmt01\n\n```\nsmoke tests\n```\n[vagrant@client01 ~]$ beegfs-ctl --listnodes --nodetype=meta --nicdetails\nmeta01 [ID: 1]\n   Ports: UDP: 8005; TCP: 8005\n   Interfaces:\n   + eth1[ip addr: 192.168.44.20; type: TCP]\n   + eth0[ip addr: 10.0.2.15; type: TCP]\n\nNumber of nodes: 1\nRoot: 1\n\n\n[vagrant@client01 ~]$ beegfs-ctl --listnodes --nodetype=storage --nicdetails\nstorage01 [ID: 1]\n   Ports: UDP: 8003; TCP: 8003\n   Interfaces:\n   + eth1[ip addr: 192.168.44.30; type: TCP]\n   + eth0[ip addr: 10.0.2.15; type: TCP]\n\nNumber of nodes: 1\n\n\n[vagrant@client01 ~]$ beegfs-ctl --listnodes --nodetype=client --nicdetails\n4F34-5DE9100E-client01 [ID: 1]\n   Ports: UDP: 8004; TCP: 0\n   Interfaces:\n   + eth1[ip addr: 192.168.44.40; type: TCP]\n   + eth0[ip addr: 10.0.2.15; type: TCP]\n\nNumber of nodes: 1\n\n\n# Displays connections the client is actually using\n[vagrant@client01 ~]$ beegfs-net\n\nmgmt_nodes\n=============\nmgmt01 [ID: 1]\n   Connections: TCP: 1 (192.168.44.10:8008);\n\nmeta_nodes\n=============\nmeta01 [ID: 1]\n   Connections: TCP: 1 (192.168.44.20:8005);\n\nstorage_nodes\n=============\nstorage01 [ID: 1]\n   Connections: TCP: 1 (192.168.44.30:8003);\n\n\n# Displays possible connectivity of the services\n   [vagrant@client01 ~]$ beegfs-check-servers\n   Management\n   ==========\n   mgmt01 [ID: 1]: reachable at 192.168.44.10:8008 (protocol: TCP)\n\n   Metadata\n   ==========\n   meta01 [ID: 1]: reachable at 192.168.44.20:8005 (protocol: TCP)\n\n   Storage\n   ==========\n   storage01 [ID: 1]: reachable at 192.168.44.30:8003 (protocol: TCP)\n\n\n\n# Displays free space and inodes of storage and metadata targets\n[vagrant@client01 ~]$ beegfs-df\nMETADATA SERVERS:\nTargetID        Pool        Total         Free    %      ITotal       IFree    %\n========        ====        =====         ====    =      ======       =====    =\n       1      normal      41.0GiB      39.6GiB  97%       20.5M       20.4M 100%\n\nSTORAGE TARGETS:\nTargetID        Pool        Total         Free    %      ITotal       IFree    %\n========        ====        =====         ====    =      ======       =====    =\n       1         low      41.0GiB      39.6GiB  97%       20.5M       20.5M 100%\n\n\u003chttps://www.beegfs.io/wiki/ManualInstallWalkThrough\u003e\n```\n\nBenchmarking\n```\nstarts a write benchmark on all targets of all BeeGFS storage servers with an IO blocksize of 512 KB, using 10 threads (i.e. simulated client streams) per target, each of which will write 200 GB of data to its own file   \n$sudo beegfs-ctl --storagebench --alltargets --write --blocksize=512K --size=200G --threads=10\n\nquery the benchmark status/result of all targets  \n$sudo beegfs-ctl --storagebench --alltargets --status\n\nuse the watch command for repeating the query in a given interval in seconds  \n$watch -n 1 beegfs-ctl --storagebench --alltargets --status\n\nThe generated files will not be automatically deleted when a benchmark is complete   \n$beegfs-ctl --storagebench --alltargets --cleanup\n\n\nIOR  \nThe value for the number of processes ${NUM_PROCS} depends on the number of clients to test and the number of processes per client. The block size ${BLOCK_SIZE} can be calculated with ((3 * RAM_SIZE_PER_STORAGE_SERVER * NUM_STORAGE_SERVERS) / ${NUM_PROCS}).\n\nMulti-stream Throughput Benchmark  \n$ mpirun -hostfile /tmp/nodefile --map-by node -np ${NUM_PROCS} /usr/bin/IOR -wr -i5 -t2m -b ${BLOCK_SIZE} -g -F -e\n-o /mnt/beegfs/test.ior\n\nShared File Throughput Benchmark  \n$ mpirun -hostfile /tmp/nodefile --map-by node -np ${NUM_PROCS} /usr/bin/IOR -wr -i5 -t1200k -b ${BLOCK_SIZE} -g -e\n-o /mnt/beegfs/test.ior\n\nIOPS Benchmark   \n$ mpirun -hostfile /tmp/nodefile --map-by node -np ${NUM_PROCS} /usr/bin/IOR -w -i5 -t4k -b ${BLOCK_SIZE} -F -z -g\n-o /mnt/beegfs/test.ior\n\n\nMDTEST  \n\nThe value for the number of processes ${NUM_PROCS} depends on the number on clients to test and the number of processes per client to test. The number of directories can be calculated as ${NUM_DIRS} = (parameter -b ^ parameter -z). The total amount of files should always be higher than 1 000 000, so ${FILES_PER_DIR} is calculated as ${FILES_PER_DIR} = (1000000 / ${NUM_DIRS} / ${NUM_PROCS}).\n\nFile Create/Stat/Remove Benchmark   \n$ mpirun -hostfile /tmp/nodefile --map-by node -np ${NUM_PROCS} mdtest -C -T -r -F -d /mnt/beegfs/mdtest -i 3 -I ${FILES_PER_DIR} -z 2 -b 8 -L -u   \nhttps://www.beegfs.io/wiki/Benchmark#externaltools\n\nBeeGFS®Benchmarks on IBM OpenPOWERServers   \n\u003chttps://www.beegfs.io/docs/whitepapers/IBM_OpenPower_P8_BeeGFS_Performance_by_ThinkParQ.pdf\u003e\n\nHowTo Configure and Test BeeGFS with RDMA\n\u003chttps://community.mellanox.com/s/article/howto-configure-and-test-beegfs-with-rdma\u003e\n```\n```\nBeegfs Sandbox Testing .Cross-platform via vagrant Linux, Windows, Mac.\n\n\nBeeGFS (formerly FhGFS) is the leading parallel cluster file system.\nLatest Stable Version: 7.1.2    \nhttps://www.beegfs.io\n\nCentos 7.7  \nhttps://www.centos.org/download/\n\nDownload Vagrant.  \n\u003evagrant version\nInstalled Version: 2.2.6\nLatest Version: 2.2.6  \nhttps://www.vagrantup.com/downloads.html\n\nAnsible Local Provisioner   \nhttps://www.vagrantup.com/docs/provisioning/ansible_local.html\n\nAnsible\nansible --version ansible 2.9.1  \nhttps://www.ansible.com/\n\nDownload Oracle VM VirtualBox  \n\u003eVBoxManage -version\n6.0.14r133895       \nhttps://www.virtualbox.org/wiki/Downloads\n```\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgithubfoam%2Fbeegfs-sandbox","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgithubfoam%2Fbeegfs-sandbox","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgithubfoam%2Fbeegfs-sandbox/lists"}