{"id":17336391,"url":"https://github.com/jasonyangshadow/experiment_attachments","last_synced_at":"2025-03-27T07:25:31.401Z","repository":{"id":70083286,"uuid":"261243614","full_name":"JasonYangShadow/experiment_attachments","owner":"JasonYangShadow","description":"experiment attachments for LPMX","archived":false,"fork":false,"pushed_at":"2021-09-05T12:41:41.000Z","size":972,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-02-01T12:28:30.946Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/JasonYangShadow.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-05-04T16:53:28.000Z","updated_at":"2021-09-05T12:41:44.000Z","dependencies_parsed_at":"2023-03-01T17:45:41.838Z","dependency_job_id":null,"html_url":"https://github.com/JasonYangShadow/experiment_attachments","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JasonYangShadow%2Fexperiment_attachments","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JasonYangShadow%2Fexperiment_attachments/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JasonYangShadow%2Fexperiment_attachments/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JasonYangShadow%2Fexperiment_attachments/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/JasonYangShadow","download_url":"https://codeload.github.com/JasonYangShadow/experiment_attachments/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245800188,"owners_count":20674254,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-15T15:29:51.357Z","updated_at":"2025-03-27T07:25:31.390Z","avatar_url":"https://github.com/JasonYangShadow.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Experiments Attachments For LPMX\nThis repository contains benchmark experiment scripts for LPMX.\n\nTo reproduce the experiments inside this repository, virtualbox and vagrant are needed.\n## Requirement\n1. Vagrant [https://www.vagrantup.com/](https://www.vagrantup.com/)\n2. Oracle VM Virtualbox [https://www.virtualbox.org/](https://www.virtualbox.org/)\n\n## To reproduce the composability experiment\nopen the terminal on your machine and type the following commands:\n```\nvagrant box add jasonyangshadow/composability\nvagrant init jasonyangshadow/composability\nvagrant up\nvagrant ssh\n```\n\nThen you are in the virtual machine and all containers used in the experiment are configured and installed properly\n\nA shell script named `run.sh` inside the home directory is used for the composability experiment, which has the very same content of the script named `composability.sh` inside this repository. Another script named `composability_helper.sh` is the real script executed inside the container for real genome analysis. Anyway, you do not need to download and put these scripts inside virtual machines, because they are also packaged and included inside the exported vagrant box. \n\n## To reproduce the benchmark experiment\nopen the terminal on your machine and type the following commands:\n```\nvagrant box add jasonyangshadow/benchmark_ubuntu1804\nvagrant init jasonyangshadow/benchmark_ubuntu1804\nvagrant up\nvagrant ssh\n```\nThen you are in the virtual machine and all containers used in the experiment are configured and installed properly\n\nA shell script named `installation_benchmark.sh` inside the home directory is used for the package installation performance benchmark test. It contains necessary bash commands for automating the experiment, just run it by the following command:\n\nThe time cost for installing packages is evaluated by the **time** command available in the Linux system.\n```\ncd ~ \u0026\u0026 ./installation_benchmark.sh\n```\n\nAnother shell script named `container_creation_benchmark.sh` inside the home directory is used for the container creation benchmark test. It also contains necessary bash commands for automating the experiment.\n\nTo run the bash script:\n```\ncd ~ \u0026\u0026 ./container_creation_benchmark.sh\n```\n\nAlso for a python script named `image_convertion_benchmark.py`, it is used for Docker image convertion benchmark test for Singularity and LPMX. It is also included inside the exported box.\n\n## Scripts inside sv folder\nThe scripts included inside the sv folder is the GATK SV call executed on HPC (shirokane supercomputer), these scripts could not directly run in your environment, but they can help you reproduce these experiments to some extends. The script named `hg002_generate_data.py` will help generate and download necessary HG002 reads and this data can be used for further analysis shown in sv scripts folder. LPMX and bare host use different commands to launch the analysis tools, so please be careful on the paths of data. \nDate used inside the experiment:\nGRCh38: https://hgdownload.soe.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz  \nHG002: file `HG002_data_list`\n\n## GPGPU Guppy basecaller experiment\nThe data used inside the GPGPU mode of Guppy basecaller is available from the file `NA12878-IVT-RNA_All.files.txt`\n\n## Raw experiment data file is `experiment_data.xlsx`\n\n## Notice:\nAll these experiment scripts are updated and available at [https://github.com/JasonYangShadow/experiment_attachments](https://github.com/JasonYangShadow/experiment_attachments), make sure receiving the latest version from the Github repository. \n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjasonyangshadow%2Fexperiment_attachments","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjasonyangshadow%2Fexperiment_attachments","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjasonyangshadow%2Fexperiment_attachments/lists"}