{"id":42794369,"url":"https://github.com/qbicsoftware/openbis20-java-dropboxes","last_synced_at":"2026-01-30T00:26:20.975Z","repository":{"id":239165451,"uuid":"797128296","full_name":"qbicsoftware/openbis20-java-dropboxes","owner":"qbicsoftware","description":"ETL procedures written in Java for data registration in openBIS version 20","archived":false,"fork":false,"pushed_at":"2024-05-17T14:19:09.000Z","size":47,"stargazers_count":0,"open_issues_count":1,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-05-17T15:52:50.041Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Groovy","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/qbicsoftware.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-05-07T08:47:19.000Z","updated_at":"2024-05-27T12:13:56.545Z","dependencies_parsed_at":"2024-05-17T15:41:50.244Z","dependency_job_id":null,"html_url":"https://github.com/qbicsoftware/openbis20-java-dropboxes","commit_stats":null,"previous_names":["qbicsoftware/openbis20-java-dropboxes"],"tags_count":0,"template":false,"template_full_name":"qbicsoftware/spring-boot-starter-template","purl":"pkg:github/qbicsoftware/openbis20-java-dropboxes","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qbicsoftware%2Fopenbis20-java-dropboxes","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qbicsoftware%2Fopenbis20-java-dropboxes/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qbicsoftware%2Fopenbis20-java-dropboxes/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qbicsoftware%2Fopenbis20-java-dropboxes/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/qbicsoftware","download_url":"https://codeload.github.com/qbicsoftware/openbis20-java-dropboxes/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qbicsoftware%2Fopenbis20-java-dropboxes/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28891435,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-29T21:06:44.224Z","status":"ssl_error","status_checked_at":"2026-01-29T21:06:42.160Z","response_time":59,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-01-30T00:26:18.898Z","updated_at":"2026-01-30T00:26:20.970Z","avatar_url":"https://github.com/qbicsoftware.png","language":"Groovy","funding_links":[],"categories":[],"sub_categories":[],"readme":"# OpenBiS Dropboxes\n\n!!! abstract\nAfter the [Data Scanner](https://github.com/qbicsoftware/data-processing), data registration in openbis can be automated by dropboxes.\nWe use Java Dropboxes to move files into OpenBis (see\nthe [Documentation on Java Dropboxes](https://openbis.readthedocs.io/en/20.10.x/software-developer-documentation/server-side-extensions/dss-dropboxes.html#java-dropboxes))\n\n## Context\n\n```mermaid\nsequenceDiagram\n  autonumber\n  User -\u003e\u003e SFTP Folder : move files\n  Data Scanner -\u003e\u003e SFTP Folder : is new data present?\n  SFTP Folder -\u003e\u003e Data Scanner : Yes\n  Data Scanner -\u003e\u003e Dropbox Incoming : move files\n  Data Scanner -\u003e\u003e Dropbox Incoming : create marker file\n  Dropbox -\u003e\u003e Dropbox Incoming : Is marker file present?\n  Dropbox Incoming -\u003e\u003e Dropbox : Yes\n  Dropbox -\u003e\u003e OpenBiS : Register data\n```\n\n\n### Dropbox Process\n\nThe dropbox processes the data before moving it into OpenBiS. A successful processing is shown\nbelow.\n\nThe process is triggered when a marker filed called `MARKER_is_finished_\u003cdirname\u003e` with `\u003cdirname\u003e` being the folder to be registered, is created.\n\n``` mermaid\nsequenceDiagram\n  autonumber\n  IncomingFolder -\u003e\u003e Dropbox: Folder and Markerfile exist\n  Dropbox -\u003e\u003e IncomingFolder: Read provenance.json\n  Dropbox -\u003e\u003e Dropbox: Parse measurement ID\n  Dropbox -\u003e\u003e OpenBiS DSS: Get measurement sample\n  OpenBiS DSS -\u003e\u003e Dropbox: Give measurement sample\n  Dropbox -\u003e\u003e OpenBiS DSS: Has measurement datasets?\n  OpenBiS DSS -\u003e\u003e Dropbox: No\n  Dropbox -\u003e\u003e Dropbox: Parse measurement properties\n  Dropbox -\u003e\u003e OpenBiS DSS: Create dataset\n  Dropbox -\u003e\u003e OpenBiS DSS: Send files to dataset\n```\n\n### Dropbox Configuration\n\nThe dropbox configuration can be found\nat `...` on the OpenBiS instance. Each folder within this directory creates a dropbox.\n\nWithin each folder exists a directory `lib` and a file `plugin.properties`. The `lib` folder is\nwhere you place your dropbox `jar` file. The `plugin.properties` is where you configure your\ndropbox.\n\n```properties title=\"plugin.properties\" linenums=\"1\"\nincoming-dir=...\nincoming-data-completeness-condition=marker-file\ntop-level-data-set-handler=ch.systemsx.cisd.etlserver.registrator.api.v2.JavaTopLevelDataSetHandlerV2\nprogram-class=life.qbic.registration.openbis.OpenBisDropboxETL\nstorage-processor=ch.systemsx.cisd.etlserver.DefaultStorageProcessor\n```\n!!! info\nUsusally you only need to adapt the `incoming-dir` and `program-class` when setting up a new dropbox.\nFor more configuration options please see the [OpenBiS documentation](https://openbis.readthedocs.io/en/20.10.x/software-developer-documentation/server-side-extensions/dss-dropboxes.html#configuration).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fqbicsoftware%2Fopenbis20-java-dropboxes","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fqbicsoftware%2Fopenbis20-java-dropboxes","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fqbicsoftware%2Fopenbis20-java-dropboxes/lists"}