{"id":19572582,"url":"https://github.com/elsa-lab/training-noodles","last_synced_at":"2026-01-19T11:01:47.275Z","repository":{"id":57476874,"uuid":"189238035","full_name":"elsa-lab/training-noodles","owner":"elsa-lab","description":"Train multiple programs on multiple servers without pain","archived":false,"fork":false,"pushed_at":"2020-07-26T08:59:34.000Z","size":6704,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-08-30T08:53:20.370Z","etag":null,"topics":["automation","deployment","instant","linux","machine-learning","noodles","server-management"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/elsa-lab.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-05-29T14:07:45.000Z","updated_at":"2020-07-26T08:59:36.000Z","dependencies_parsed_at":"2022-09-14T17:11:06.093Z","dependency_job_id":null,"html_url":"https://github.com/elsa-lab/training-noodles","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/elsa-lab/training-noodles","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/elsa-lab%2Ftraining-noodles","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/elsa-lab%2Ftraining-noodles/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/elsa-lab%2Ftraining-noodles/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/elsa-lab%2Ftraining-noodles/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/elsa-lab","download_url":"https://codeload.github.com/elsa-lab/training-noodles/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/elsa-lab%2Ftraining-noodles/sbom","scorecard":{"id":373866,"data":{"date":"2025-08-11","repo":{"name":"github.com/elsa-lab/training-noodles","commit":"9d16ff7045bde5bda9597bcad49a8f8c2c3b4ed3"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":2.8,"checks":[{"name":"Code-Review","score":0,"reason":"Found 0/30 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Token-Permissions","score":-1,"reason":"No tokens found","details":null,"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Dangerous-Workflow","score":-1,"reason":"no workflows found","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"SAST","score":0,"reason":"no SAST tool detected","details":["Warn: no pull requests merged into dev branch"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Vulnerabilities","score":10,"reason":"0 existing vulnerabilities detected","details":null,"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE.txt:0","Info: FSF or OSI recognized license: MIT License: LICENSE.txt:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Warn: pipCommand not pinned by hash: scripts/dev/install.sh:12","Warn: pipCommand not pinned by hash: scripts/dev/publish.sh:14","Warn: pipCommand not pinned by hash: scripts/dev/publish.sh:15","Warn: pipCommand not pinned by hash: scripts/dev/test_online_package.sh:30","Warn: pipCommand not pinned by hash: scripts/dev/test_wheel.sh:36","Info:   0 out of   5 pipCommand dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'master'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}}]},"last_synced_at":"2025-08-18T13:42:30.849Z","repository_id":57476874,"created_at":"2025-08-18T13:42:30.849Z","updated_at":"2025-08-18T13:42:30.849Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28565876,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-19T08:53:44.001Z","status":"ssl_error","status_checked_at":"2026-01-19T08:52:40.245Z","response_time":67,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["automation","deployment","instant","linux","machine-learning","noodles","server-management"],"created_at":"2024-11-11T06:27:26.015Z","updated_at":"2026-01-19T11:01:47.252Z","avatar_url":"https://github.com/elsa-lab.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Training Noodles\n\n[![documentation_link](https://img.shields.io/badge/docs-online-brightgreen.svg)](https://elsa-lab.github.io/training-noodles/) [![travis_build_status](https://travis-ci.org/elsa-lab/training-noodles.svg?branch=master)](https://travis-ci.org/elsa-lab/training-noodles)\n\nA simple and powerful tool to help training **multiple** programs on **multiple** servers with only one human.\n\n## Features\n\n* Automatically deploys experiments to available servers\n* No need to change any existing code\n* Considers CPU usage, GPU usage, memory usage, disk usage, and more\n* Uses only SSH protocol\n* Relies on minimal dependencies\n* Allows fast prototyping\n\n## Use Case\n\nIf we want to run 4 experiments on 3 servers, more specifically, we need to\n\n1. Upload the code to one of the servers which has low CPU usage\n2. Run the code on the server\n3. Download experimental results when they're ready\n\n![deployment_round_1](https://github.com/elsa-lab/training-noodles/raw/master/images/round_1.png)\n\nIn the first deployment round (See image above), Noodles will use the user-defined commands to check CPU usage on the servers.\n\nThe CPU usage is high on *Server 1* because there are some other programs running, so Noodles uses `scp` to upload the code *Code 1* and *Code 2*, and run them on *Server 2* and *Server 3* respectively.\n\nAs for how to upload the code, it's just a list of commands written by us, Noodles just follows the commands.\n\n![deployment_round_2](https://github.com/elsa-lab/training-noodles/raw/master/images/round_2.png)\n\nIn the second deployment round (See image above), we tell Noodles to check experimental results on all servers.\n\nNoodles finds that *Server 3* has just finished running *Code 2*, so it downloads the experimental results and process the data on local machine as we tell it to do so.\n\n![deployment_round_3](https://github.com/elsa-lab/training-noodles/raw/master/images/round_3.png)\n\nIn the third deployment round (See image above), *Code 3* and *Code 4* still need to be deployed. Noodles checks the CPU usage on all servers again. As *Server 1* has just become free now, Noodles can deploy *Code 3* and *Code 4* to *Server 1* and *Server 3* respectively.\n\nThe deployment round would continue until all experiments are successfully deployed. As in this case, Noodles will try to download and process the experimental results of *Code 1*, *Code 3* and *Code 4* in later rounds.\n\n## How Noodles Works\n\nThe general procedure is as follows:\n\n1. Initialize the list of experiments in **E**\n2. For each deployment round:\n    1. Initialize the list of servers in **S**\n    2. For each experiment in **E**:\n        1. Noodles runs user-defined requirements on each server in **S**\n        2. Noodles compares the metrics (results from the above step) to the user-defined expression\n        3. If the expression is satisfied:\n            1. Noodles runs the user-defined commands on the satisfied server\n            2. Remove the current experiment from **E**\n            3. Remove the satisfied server from **S**\n            4. If **S** is empty, break\n    3. If **E** is empty, break\n\nThe implementation of Noodles complies with the following rules:\n\n1. Simple (User can understand code and spec without looking documentation)\n2. Easy to debug (Noodles can take different actions when different error occurs)\n3. Stateless (The only state Noodles cares about is whether the deployment is successful or not, the states of the experiments must be handled by the user)\n\n## Documentation\n\nSee full documentation [here](https://elsa-lab.github.io/training-noodles/).\n\n## Prerequisites\n\n1. Linux-based terminals (For Windows, I recommend using [git-sdk](https://github.com/git-for-windows/build-extra/releases))\n2. Python 3.5 or higher\n\n## Installation\n\nRun the following command:\n\n```bash\npip install training-noodles\n```\n\n## Usage\n\n```bash\nnoodles \u003ccommand_type\u003e \u003cpath_to_spec\u003e\n```\n\nIt's just that simple.\n\n## Examples\n\nHere are some examples showing how Noodles is used:\n\n```bash\nnoodles run my_training.yml\nnoodles status my_training.yml\nnoodles monitor my_training.yml\nnoodles stop my_training.yml\nnoodles download my_training.yml\nnoodles upload my_training.yml\n...\n```\n\nYou can also choose only some experiments:\n\n```bash\nnoodles run \"my_training.yml:Experiment 1,Experiment 2\"\n```\n\nSee the example [Two Locals](https://github.com/elsa-lab/training-noodles/tree/master/examples/two_locals) to get started. See [Train TensorFlow Examples](https://github.com/elsa-lab/training-noodles/tree/master/examples/train_tensorflow_examples) for a more complex example.\n\n## Default Spec\n\nNoodles will use properties from default spec if the user spec doesn't specify them. See [training_noodles/specs/defaults.yml](https://github.com/elsa-lab/training-noodles/blob/master/training_noodles/specs/defaults.yml) for the default spec.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Felsa-lab%2Ftraining-noodles","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Felsa-lab%2Ftraining-noodles","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Felsa-lab%2Ftraining-noodles/lists"}