Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/dominodatalab/domino-maintenance-mode
Easily place Domino in maintenance mode for upgrades and restore afterwards.
https://github.com/dominodatalab/domino-maintenance-mode
Last synced: 29 days ago
JSON representation
Easily place Domino in maintenance mode for upgrades and restore afterwards.
- Host: GitHub
- URL: https://github.com/dominodatalab/domino-maintenance-mode
- Owner: dominodatalab
- Created: 2022-08-26T20:10:53.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-11-14T15:10:49.000Z (about 1 month ago)
- Last Synced: 2024-11-14T16:23:54.523Z (about 1 month ago)
- Language: Python
- Size: 54.7 KB
- Stars: 5
- Watchers: 11
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# domino-maintenance-mode
Easily place Domino in maintenance mode for upgrades and restore afterwards.
[](https://quay.io/repository/domino/dmm)
# How to report bugs
Please file in a ticket to the Platform Services team.
[Create a Jira ticket](https://dominodatalab.atlassian.net/secure/CreateIssueDetails!init.jspa?pid=10103&issuetype=10004&customfield_12800=10800&customfield_12907=11003&customfield_12959=11118&versions=12744&fixVersions=12744&customfield_12952=12138&priority=4&summary=%5BMaintenance%20Mode%20Script%5D%20-%20)
# Warnings
* It is important that the system is not being used while taking a snapshot until after the restore is complete. Changes to running executions during or after taking a snapshot of the system may result in executions not being fully stopped, or properly restored. If there are new Model API versions that are not fully updated (new version is in running state and old version is fully stopped), please allow this process to complete before using this tool.
* It is possible for a running, functioning App to have a PVC mounted from an unregistered EDV that it depends on. Since the EDV no longer exists, the App cannot be restarted with this PVC mounted and can fail. It is not possible to detect this scenario automatically via the API. Please do not unregister EDVs while in maintenance mode.
* If either stopping or starting fails because the API returned an error, or the operation timed out while waiting for the execution to enter at running state, the tool will emit a warning and save a record of the executions which failed to a log file. This is in JSON format and can be used to follow up manually.
* Any `error` log levels or above require manual inspection to determine the state of an execution or executions.
# Installation
`pip install git+https://github.com/dominodatalab/domino-maintenance-mode.git`
Note: Currently requires python < 3.11
# Configuration
You must set some environment variables to configure access to the Domino deployment.
* `DOMINO_API_KEY` - An administrator's Domino API key.
* `DOMINO_HOSTNAME` - The URL to your Domino deployment, including protocol (and port if non-standard).
* `DOMINO_SSL_NO_VERIFY` - **Optional** Set to "true" to disabled server certificate verification.
# Usage
* Take a snapshot of running executions:
```
dmm snapshot my-snapshot-file.json
```
This will create a timestamped snapshot file which you will need to use in subsequent steps.
* Stop all running Apps, Model APIs, Restartable Workspaces, and Scheduled Jobs:
```
dmm shutdown my-snapshot-file.json
```
* Perform Domino maintenance / upgrade.
* Restore previously running Apps, Model APIs and Scheduled Jobs. Workspaces should be manually restarted by users.
```
dmm restore my-snapshot-file.json
```
# Domino Version Support
**Domino 4.4+**, please report any issues that may arise due to API changes, as not all versions have been validated.
Classic Workspaces are not currently supported and should be shutdown manually.