{"id":24775683,"url":"https://github.com/inseefr/pearl-jam-batch","last_synced_at":"2025-10-12T00:31:27.726Z","repository":{"id":40353643,"uuid":"373203155","full_name":"InseeFr/Pearl-Jam-Batch","owner":"InseeFr","description":"Batch processing services for Peal Jam","archived":false,"fork":false,"pushed_at":"2025-09-30T08:47:42.000Z","size":627,"stargazers_count":0,"open_issues_count":3,"forks_count":2,"subscribers_count":8,"default_branch":"main","last_synced_at":"2025-09-30T09:26:17.530Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/InseeFr.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2021-06-02T14:46:14.000Z","updated_at":"2025-08-08T11:08:46.000Z","dependencies_parsed_at":"2023-12-15T12:44:42.946Z","dependency_job_id":"4cfc2192-4863-44d7-b2d9-a7587a4a367f","html_url":"https://github.com/InseeFr/Pearl-Jam-Batch","commit_stats":null,"previous_names":[],"tags_count":55,"template":false,"template_full_name":null,"purl":"pkg:github/InseeFr/Pearl-Jam-Batch","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InseeFr%2FPearl-Jam-Batch","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InseeFr%2FPearl-Jam-Batch/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InseeFr%2FPearl-Jam-Batch/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InseeFr%2FPearl-Jam-Batch/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/InseeFr","download_url":"https://codeload.github.com/InseeFr/Pearl-Jam-Batch/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/InseeFr%2FPearl-Jam-Batch/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279009509,"owners_count":26084609,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-11T02:00:06.511Z","response_time":55,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-01-29T06:55:17.727Z","updated_at":"2025-10-12T00:31:26.687Z","avatar_url":"https://github.com/InseeFr.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# PearlJam-Back-Office\r\nBatch service for PearlJam  \r\nBatch using to implement PEARLJAM DB from xml files.\r\n\r\n## Requirements\r\nFor building and running the application you need:\r\n- [JDK 1.11](https://jdk.java.net/archive/)\r\n- Maven 3\r\n\r\n## Install and excute unit tests and ent-to-end tests\r\nUse the maven clean and maven install  \r\n``` shell\r\nmvn clean install\r\n```\r\n\r\n## Running batch\r\nUse the folowing cmd :\r\n``` shell\r\necho $@\r\njava8 -Xms64m -Xmx512m -classpath '/path/to/lib/*' -Dlog4j.configurationFile=file:/path/to/log4j2.xml -Dproperties.path=/path/to/properties -DcheminLog=/path/to/properties log fr.insee.pearljam.batch.Lanceur $@\r\nCODE_ERREUR=$? [DELETECAMPAIGN] || [LOADCAMPAIGN] || [LOADCONTEXT] || [DAILYUPDATE] || [SYNCHRONIZE] || [SAMPLEPROCESSING])\r\necho \"CODE ERREUR=$CODE_ERREUR\"\r\nexit $CODE_ERREUR\r\n```\r\n\r\n#### Properties file\r\nSome properties are externalized in ${path.properties}/pearljam-bo.properties.  \r\nBellow, properties to define :\r\n``` shell\r\nfr.insee.pearljam.persistence.database.host = localhost\r\nfr.insee.pearljam.persistence.database.port = 5433\r\nfr.insee.pearljam.persistence.database.schema = XXXXXXXX\r\nfr.insee.pearljam.persistence.database.user = XXXXXXXX\r\nfr.insee.pearljam.persistence.database.password = XXXXXXXX\r\nfr.insee.pearljam.persistence.database.driver = org.postgresql.Driver\r\nfr.insee.pearljam.folder.in=path/to/in\r\nfr.insee.pearljam.folder.out=path/to/out\r\nfr.insee.pearljam.folder.queen.in=path/to/in\r\nfr.insee.pearljam.folder.queen.out=path/to/out\r\n\r\n# Context referential URL\r\nfr.insee.pearljam.context.referential.service.url.scheme=http\r\nfr.insee.pearljam.context.referential.service.url.host=localhost\r\nfr.insee.pearljam.context.referential.service.url.port=8080\r\nfr.insee.pearljam.context.referential.service.url.path=/XXXXXXXX\r\n\r\n#Maximum number of SU reaffected to an other interviewer during synchronization\r\nfr.insee.pearljam.context.synchronization.interviewers.reaffectation.threshold.absolute=2\r\n#Maximum percentage SU reaffected to an other interviewer / SU processed during synchronization\r\nfr.insee.pearljam.context.synchronization.interviewers.reaffectation.threshold.relative=50\r\n#Maximum number of SU reaffected to an other OU during synchronization\r\nfr.insee.pearljam.context.synchronization.organization.reaffectation.threshold.absolute=2\r\n#Maximum percentage SU reaffected to an other OU / SU processed during synchronization\r\nfr.insee.pearljam.context.synchronization.organization.reaffectation.threshold.relative=50\r\n\r\n\r\n#Keycloak configuration\r\nkeycloak.auth-server-url=http://localhost:8180/auth\r\nkeycloak.realm=XXX\r\nkeycloak.client.id=XXX\r\nkeycloak.client.secret=XXXXXX\r\n\r\n# Log created and updated elements in the result file? ( YES | NO | IN_SEPARATE_FILE )\r\nfr.insee.pearljam.context.synchronization.log.elements=YES\r\n\r\n# Queen-batch configuration\r\nfr.insee.queen.application.persistenceType=JPA\r\n\r\nfr.insee.queen.persistence.database.host = localhost\r\nfr.insee.queen.persistence.database.port = 5432\r\nfr.insee.queen.persistence.database.schema = XXXXXXXX\r\nfr.insee.queen.persistence.database.user = XXXXXXXX\r\nfr.insee.queen.persistence.database.password = XXXXXXXX\r\nfr.insee.queen.persistence.database.driver = org.postgresql.Driver\r\n\r\nfr.insee.queen.key.paradata.id=idSu\r\nfr.insee.queen.key.paradata.events=events\r\n\r\n```\r\n\r\n## Before you commit\r\nBefore committing code please ensure,  \r\n1 - README.md is updated  \r\n2 - A successful build is run and all tests are sucessful  \r\n3 - All newly implemented APIs are documented  \r\n4 - All newly added properties are documented  \r\n\r\n## Libraries used\r\n- spring-core\r\n- spring-jdbc\r\n- spring-oxm\r\n- spring-data-jpa\r\n- spring-web\r\n- commons-lang3\r\n- postgresql\r\n- liquibase\r\n- spring-test\r\n- test-containers\r\n- json-simple\r\n- jackson-core\r\n- jackson-databind\r\n- log4j\r\n\r\n## Developers\r\n- Benjamin Claudel (benjamin.claudel@keyconsulting.fr)\r\n- Samuel Corcaud (samuel.corcaud@keyconsulting.fr)\r\n- Paul Guillemet (paul.guillemet@keyconsulting.fr)","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finseefr%2Fpearl-jam-batch","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Finseefr%2Fpearl-jam-batch","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finseefr%2Fpearl-jam-batch/lists"}