{"id":19292144,"url":"https://github.com/nasa-pds/operations","last_synced_at":"2025-04-22T06:32:02.467Z","repository":{"id":37534074,"uuid":"276547328","full_name":"NASA-PDS/operations","owner":"NASA-PDS","description":"Tickets for the PDSEN Operations Team","archived":false,"fork":false,"pushed_at":"2025-03-18T21:13:48.000Z","size":711,"stargazers_count":6,"open_issues_count":53,"forks_count":1,"subscribers_count":9,"default_branch":"main","last_synced_at":"2025-04-01T20:31:50.861Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/NASA-PDS.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-07-02T04:21:37.000Z","updated_at":"2025-03-18T21:13:52.000Z","dependencies_parsed_at":"2023-02-16T23:45:46.249Z","dependency_job_id":"50e4d9bf-eb90-47c4-bc17-3d1a808143bf","html_url":"https://github.com/NASA-PDS/operations","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":"NASA-PDS/template-repo-java","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NASA-PDS%2Foperations","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NASA-PDS%2Foperations/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NASA-PDS%2Foperations/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NASA-PDS%2Foperations/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/NASA-PDS","download_url":"https://codeload.github.com/NASA-PDS/operations/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250183285,"owners_count":21388687,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-09T22:29:26.863Z","updated_at":"2025-04-22T06:32:02.461Z","avatar_url":"https://github.com/NASA-PDS.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# NASA PDS Engineering Node Operations Team\n\nThis repository is a repo to track issues intended for the [Planetary Data System (PDS)](https://pds.nasa.gov/) [Engineering Node (EN)](https://nasa-pds.github.io/) Operations Team. These issues may include, but are not limited to, PDS4 NSSDCA Deliveries via [PDS Deep Archive](https://nasa-pds.github.io/pds-deep-archive/), data releases, website updates, or other actions where a corresponding GitHub repository is unknown.\n\n# Support\n\nFor help with the PDS Engineering Node, you can either create a ticket in [GitHub Issues](https://github.com/NASA-PDS/pdsen-operations/issues) or email pds-operator@jpl.nasa.gov for more assistance.\n\n\n# Installation\n\nThis section specifies the requirements needed to run the software in this repository and gives narrative instructions on performing the installation.\n\n\n## System Requirements\n\nPrior to installing this software, ensure your system meets the following requirements:\n\n- **Python 3**: This software requires Python 3. Python 3.9 is out now, and 3.10 is to be released imminently. Python 2 will absolutely not work, and indeed Python 2 came to its end of life January 2020.\n\nConsult your operating system instructions or system administrator to install the required packages. For those without system administrator access and are feeling anxious, you could try a local (home directory) Python 3 installation using a Miniconda installation.\n\n\n## Doing the Installation\n\nWe will install the operations too using Python [Pip](https://pip.pypa.io/en/stable/), the Python Package Installer. If you have Python on your system, you probably already have Pip; you can run `pip --help` or `pip3 -help` to check.\n\nIt's best install the tools virtual environment, so it won’t interfere with—or be interfered by—other packages. To do so:\n\n```console\n$ # Clone the repo or do a git pull if it already exists\n$ git clone https://github.com/NASA-PDS/pdsen-operations.git\n$ cd pdsen-operations\n$ # For Linux, macOS, or other Unix systems:\n$ mkdir -p $HOME/.virtualenvs\n$ python3 -m venv $HOME/.virtualenvs/pdsen-ops\n$ source $HOME/.virtualenvs/pdsen-ops/bin/activate\n$ pip3 install --requirement requirements.txt\n```\n\n---\n\n# pds-stats.py\n\nThe `pds-stats.py` script can be used to get the total download metrics for GitHub software tools. Here is an example of how to get metrics for the Validate, MILabel, and Transform tools.\n\nFor usage information run `bin/pds-stats.py --help`\n\n## Example Usage\n \n1.  Activate your virtual environment:\n\n        source $HOME/.virtualenvs/pdsen-ops/bin/activate\n\n2.  Execute the script:\n\n        bin/pds-stats.py --github_repos validate mi-label transform --token $GITHUB_TOKEN\n\n---\n\n\n# ldd-corral.py\n\nThis utility is used to autonomously generate the [data dictionaries web page](https://pds.nasa.gov/datastandards/dictionaries/index.shtml) for each PDS4 Build.\n\nThis software determines all the discipline LDDs to be included with this release, auto-generates the web page, and downloads and stages all the discipline LDDs from the LDD Github repos.\n\n\n## Configuration\n\nThe [ldd-corral configuration](https://github.com/NASA-PDS/pdsen-operations/blob/master/conf/ldds/config.yml) can be modified to add additional discipline LDDs to the workflow.\n\nFormat:\n```\n\u003cgithub-repo-name\u003e:\n    name: a title to be used in the output web page that overrides the \u003cname\u003e from the repo IngestLDD\n    description: |\n        description here\n```\n\n\n## Usage\n\nFor latest usage capabilities:\n\n    bin/ldds/ldd-corral.py  --help\n\nBase usage example (note: the `GITHUB_TOKEN` environment variable must be set):\n```console\n$ source $HOME/.virtualenvs/pdsen-ops/bin/activate\n$ ldd-corral.py  --pds4_version 1.15.0.0 --token $GITHUB_TOKEN\n```\n\n**Default outputs:**\n- Web page: `/tmp/ldd-release/dd-summary.html`\n- Discipline LDDs: `/tmp/ldd-release/pds4`\n\n---\n\n\n# LDD Utility Scripts\n\nThe LDD utility script `prep_for_ldd_release.sh` is usually run as follows:\n\n1.  Execute `bin/prep_for_ldd_release.sh` script as follows to create new branches in all Discipline LDD repositories:\n\nTBD\n\n2. Go to each Discipline LDD Repo and create Pull Requests for each new branch (branch names like IM_release_1.15.0.0).\n\n    - PR Title: PDS4 IM Release \u0026lt;IM_version\u0026gt;\n    - PR Description:\n    ```\n    ## Summary\n    ```\n    - PR Labels: `release`\n    - PR for testing LDD with new IM release.\n\n3.  If build failed on new branch, contact the LDD Steward to investigate a potential regression test failure or incompatibility with the new IM version.\n\n# Portal Scripts\n\n### pds-sync-api.py\n```\nDownload ESA PSA product XML files from search API\n\noptions:\n  -h, --help            show this help message and exit\n  -n NODE_NAME, --node-name NODE_NAME\n                        Name of the node (default psa)\n  -p DOWNLOAD_PATH, --download-path DOWNLOAD_PATH\n                        Where to create the XML files (default download)\n  -u URL, --url URL     URL of the PDS product search API (default\n                        https://pds.mcp.nasa.gov/api/search/1/products)\n  -c CONFIG, --config CONFIG\n                        What to call the harvest XML config output (default harvest.cfg)\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnasa-pds%2Foperations","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnasa-pds%2Foperations","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnasa-pds%2Foperations/lists"}