{"id":18607319,"url":"https://github.com/addono/thesis-experiment","last_synced_at":"2025-08-25T23:12:27.761Z","repository":{"id":82277193,"uuid":"282600752","full_name":"Addono/thesis-experiment","owner":"Addono","description":"Code for, and results of, the experiment conducted in \"Chaos Engineering Testing for Containerized Multi-Version Deployments\".","archived":false,"fork":false,"pushed_at":"2023-07-06T22:14:43.000Z","size":14595,"stargazers_count":0,"open_issues_count":1,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2024-12-27T00:27:25.677Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://www.overleaf.com/read/yxzbstvysmsf","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Addono.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-07-26T07:39:27.000Z","updated_at":"2022-01-19T16:00:40.000Z","dependencies_parsed_at":null,"dependency_job_id":"9c25f853-5b5b-4a35-ad5d-cbfc3be131ec","html_url":"https://github.com/Addono/thesis-experiment","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Addono%2Fthesis-experiment","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Addono%2Fthesis-experiment/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Addono%2Fthesis-experiment/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Addono%2Fthesis-experiment/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Addono","download_url":"https://codeload.github.com/Addono/thesis-experiment/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":239395786,"owners_count":19631326,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-07T02:28:58.191Z","updated_at":"2025-02-18T02:25:56.162Z","avatar_url":"https://github.com/Addono.png","language":"Jupyter Notebook","readme":"# Thesis Experiment\nThis repository contains the code needed to run the experiments and process the results for Adriaan Knapen's thesis \"[Chaos Engineering Testing for Containerized Multi-Version Deployments](https://www.overleaf.com/read/yxzbstvysmsf)\" [[KTH (Final version)](https://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-291281)] [[Aalto (Final version)](https://aaltodoc.aalto.fi/handle/123456789/103124)]. Individual parts of this tool are stored in their own directory:\n\n* **Evaluation tool**: Runs the experiment and collects results.\n* **Results**: Contains the raw measurement results collected using the evaluation tool.\n* **Analysis**: Renders plots of the results.\n\n## Evaluation Tool\n\n### Requirements\n\nYou need to have the following available on your system:\n* Python 3.8, or newer\n* `kubectl`\n* `kubectx`\n* Helm 3\n* If you want it to create a new and temporary Kubernetes cluster, then you need Digital Ocean CLI (`doctl`) locally available and authenticated\n\n### Getting started\n\nOpen a terminal in the `evaluation-tool` directory and install the dependencies:\n\n```bash\npip install -r requirements.txt\n```\n\nRun the following command to see the help.\n\n```bash\npython run.py --help\n```\n\nIf you want it to create a temporary cluster on Digital Ocean, then it sufices to run:\n```bash\npython run.py\n```\n\nOtherwise you need to have a local context which you want to use for the experiment:\n```bash\npython run.py --cluster the-name-of-my-k8s-context\n```\n\n## Results\n\nThe results for the executed tests can be found in the `./results/` folder. Each of the files contains the results for one setup using JSON Lines (`.jsonl`) file format. Each measurement is stored on a separate line as a JSON object without nesting. The keys of the object are the name of the metric.\n\n## Analysis\n\nContains a Jupyter notebook to generate the plots from the data directory. It assumes that the results are stored in the `../results/` relative to the notebook stored in `./analysis/notebook.ipynb`.\n\nThe plots are automatically published to Github Pages:\n\n`https://aknapen.nl/thesis-experiment/box_and_scatter_plot-{metric}.{file_type}`\n\nWhere `{metric}` can be `restarts`, `time_to_first_request`, `time_to_all_requests` or `time_to_initialize`. The supported values for `{file_type}` are `pdf`, `png`, `jpg` and `svg`.\n\n#### SVG\n\n[![](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-restarts.svg)](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-restarts.svg)\n[![](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_first_request.svg)](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_first_request.svg)\n[![](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_all_requests.svg)](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_all_requests.svg)\n[![](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_initialize.svg)](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_initialize.svg)\n\n#### PNG\n\n[![](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-restarts.png)](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-restarts.png)\n[![](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_first_request.png)](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_first_request.png)\n[![](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_all_requests.png)](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_all_requests.png)\n[![](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_initialize.png)](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_initialize.png)\n\n#### JPG\n\n[![](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-restarts.jpg)](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-restarts.jpg)\n[![](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_first_request.jpg)](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_first_request.jpg)\n[![](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_all_requests.jpg)](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_all_requests.jpg)\n[![](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_initialize.jpg)](https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_initialize.jpg)\n\n\n#### PDF\n\n* https://aknapen.nl/thesis-experiment/box_and_scatter_plot-restarts.pdf\n* https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_first_request.pdf\n* https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_all_requests.pdf\n* https://aknapen.nl/thesis-experiment/box_and_scatter_plot-time_to_initialize.pdf\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faddono%2Fthesis-experiment","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Faddono%2Fthesis-experiment","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faddono%2Fthesis-experiment/lists"}