https://github.com/redleader962/experiment-directory-tools
Tools to managed an experimentation run folder and create run directory based on creation date
https://github.com/redleader962/experiment-directory-tools
Last synced: about 1 year ago
JSON representation
Tools to managed an experimentation run folder and create run directory based on creation date
- Host: GitHub
- URL: https://github.com/redleader962/experiment-directory-tools
- Owner: RedLeader962
- Created: 2018-08-30T17:38:46.000Z (almost 8 years ago)
- Default Branch: master
- Last Pushed: 2018-09-07T12:49:08.000Z (over 7 years ago)
- Last Synced: 2025-04-13T09:13:48.698Z (about 1 year ago)
- Language: Python
- Size: 11.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Experiment Directory Tools
Tools to managed an experimentation run folder and create run directory based on creation date
Author: Luc Coupal
The package have two main function:
- ***create_run_directory***: A utility function to create a run directory based on creation date.
- ***clean_result_directory***: A utility function to clean a experimentation run folder based on creation date.
Structure ex:
/experiment_root_dir
/current_run
/Run--myExperiment-112250425472---20180725223506
/myExperiment_0_Gradient_clipping_threshold=0.87493
/myExperiment_1_Gradient_clipping_threshold=0.97914
...
/past_run
/Run--myExperiment-222260435473---20180725223507
...
/Run--myExperiment-232222435474---20180725223508
...
...
Usage note: use the `clean_result_directory` function before `create_run_directory` otherwise all the newly
created experiments run are going to be move to `/past_run`
##### Note:
- If `/current_run` contain more experiment than the desired kept number, they are all kept in `/past_run` until the next cleaning
- Deletion from the `/past_run` is aborted if a specified `protected_file_type` is detected in a subdirectory
- Be advise that deleted file are erase in place, they are not sent to the trash
- Tested on python 3 and osX
##### Todo:
- Add a user defined flag to prevent the deletion of a flagged important experiment
- Add a parameter & utility fct to move a specific experiment to a `important_run` folder once flagged