{"id":19830573,"url":"https://github.com/ansforge/psc-rass-loader","last_synced_at":"2025-07-05T07:35:14.904Z","repository":{"id":204499442,"uuid":"690446740","full_name":"ansforge/psc-rass-loader","owner":"ansforge","description":"module de chargement des modifications quotidiennes du RASS dans la base de données Sec-PSC","archived":false,"fork":false,"pushed_at":"2024-11-26T10:44:20.000Z","size":55041,"stargazers_count":1,"open_issues_count":6,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-11T09:50:03.977Z","etag":null,"topics":["sec-psc"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ansforge.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-09-12T08:02:42.000Z","updated_at":"2024-11-14T13:25:41.000Z","dependencies_parsed_at":null,"dependency_job_id":"c4b829a3-c325-4676-b406-6773976b9e50","html_url":"https://github.com/ansforge/psc-rass-loader","commit_stats":null,"previous_names":["ansforge/psc-rass-loader"],"tags_count":5,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ansforge%2Fpsc-rass-loader","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ansforge%2Fpsc-rass-loader/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ansforge%2Fpsc-rass-loader/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ansforge%2Fpsc-rass-loader/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ansforge","download_url":"https://codeload.github.com/ansforge/psc-rass-loader/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241189988,"owners_count":19924939,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["sec-psc"],"created_at":"2024-11-12T11:24:12.811Z","updated_at":"2025-02-28T17:25:33.370Z","avatar_url":"https://github.com/ansforge.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# pscload-v2\npscload V2\nComponent to load RASS data in psc db\n\n## Developement\n\n### Tool versions\n\nPlease note that `psc-rass-loader` depends on deprecated JDK APIs, and the build\nbreaks from JDK 21 on.\nThis can be addressed by :\n*  Installing a JDK-11 or 17 version (this can be done locally instead of system-wide)\n*  Setting up  the JAVA_HOME variable to this JDK version.\n\n### Distribution history\n\nThis ecosystem uses many independant components, some of which live an independant life in distinct repositories.\nFor each release of `psc-ps-api`, [the psc-compoents' distribution  history](https://github.com/ansforge/psc-components/blob/main/DISTRIBUTION.md) \nfile will need to be updated with the new version, so that we can keep track of compatible component versions, \nand go back to a previous working distribution if need be.\n\n### Release procedure\n\nWhenever a version is ready for release, run the following commands on the `main` branch (or on the maintenance branch if we're about to issue a production FIX). This should run on any shell, be it `bash`, `cmd` or if needed `gitbash`.\n\n```bash\nmvn release:prepare -DautoVersionSubmodules=true -DtagNameFormat=@{version}\ngit push\ngit push origin \u003cnew_version_tag\u003e\n```\n\nwhere `\u003cnew_version_tag\u003e` stands for the new version.\n\nEg to relase `1.0.1` :\n\n```bash\nmvn release:prepare -DautoVersionSubmodules=true -DtagNameFormat=@{version}\ngit push\ngit push origin 1.0.1\n```\n\n## Troubleshooting\n\nFor trouble shooting see the [DEBUG](DEBUG.md) section.\n\n## Qualification\n\nTo help qualification, two test datasets have been added (see below).\n\nTo use extract files from these datasets, set the psload key `extract_download_url` in Vault for the instance to `https://raw.githubusercontent.com/ansforge/psc-rass-loader/main/pscload/src/test/resources/\u003cdataset_name\u003e/\u003cextract name\u003e`. For example, to use the `BaseExtract.zip` extract from dataset **qualif-extracts**, use : https://raw.githubusercontent.com/ansforge/psc-rass-loader/main/pscload/src/test/resources/qualif-extracts/BaseExtract.zip\n![Where is download URL](src/main/doc/extract_download_url.png)\n\n### qualif-extracts\n\nThis datasets consists in 5 extracts + 1 toggle file (see the [qualif-extracts directory](pscload/src/test/resources/qualif-extracts))\naround 100,000 data lines :\n\n*   **BaseExtract.zip** : full 100,000 dataset to use as reference.\n*   **Extract_20.000_changes.zip** : BaseExtract.zip with 20.000 changed identities. This will trigger 20.000 updates (and switching back to `BaseExtract.zip` will trigger 20000 more updates). 20.000 deletes are 20% updated lines and willtrigger an alert.\n*   **Extract_20.000_deletes.zip** : BaseExtract.zip with 20.000 less identities. This will trigger 20.000 deletes (and siwtching back to `BaseExtract.zip` will trigger 20000 creates). 20.000 deletes are 20% deleted lines and will trigger an alert (but 20000 creates won't)\n*   **Extract_400_changes.zip** : this will trigger 400 updates (no alert as this is less than 5% change)\n*   **Extract_400_deletes.zip** : this will trigger 400 deletes (no alert as this is less than 5% change)\n*   **toggle-1.csv**: this is a toggle file to be uploaded to add or remove toggles. Of course, subsets can be used too.\n\n### CT-AMAR\n\nThis dataset consists in 3 extracts and 2 CSV files, in order (see the [CT-AMAR directory](pscload/src/test/resources/CT-AMAR)):\n\n1.  **0-RAZ.zip** : first extract, used to wipe the database.\n1.  **1-CREATES.zip** : second extract, used to create reference identities.\n1.  **2_Correspondance_ADELI_RPPS_creates.csv** : this file defines identity toggles (should be loaded through the add toggle action in the admin portal).\n1.  **3-UPDATES.zip** : this triggers updates on some identities\n1.  **4_Correspondance_ADELI_RPPS_modifications.csv** : this file defines updates in toggles, to be loaded throug the add toggle action in the admin portal.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fansforge%2Fpsc-rass-loader","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fansforge%2Fpsc-rass-loader","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fansforge%2Fpsc-rass-loader/lists"}