https://github.com/lblod/job-compression-service

https://github.com/lblod/job-compression-service

Last synced: 22 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/lblod/job-compression-service
• Owner: lblod
• License: mit
• Created: 2023-07-04T15:40:57.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2024-07-08T19:13:14.000Z (6 months ago)
• Last Synced: 2024-07-09T14:18:27.288Z (6 months ago)
• Language: JavaScript
• Size: 30.3 KB
• Stars: 0
• Watchers: 14
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# JOB COMPRESSION SERVICE

Service responsible for compressing (gzip) files within an harvesting job.

## How to

- Add to your docker-compose.yml file:

```yaml

 harvest_singleton-job:

    image: lblod/harvesting-singleton-job-service:1.0.0

    labels:

      - "logging=true"

    restart: always

    logging: *default-logging

```

- Add to your config/delta/rules.js:

```js

{

    match: {

      predicate: {

        type: 'uri',

        value: 'http://www.w3.org/ns/adms#status',

      },

      object: {

        type: 'uri',

        value: 'http://redpencil.data.gift/id/concept/JobStatus/scheduled',

      },

    },

    callback: {

      method: 'POST',

      url: 'http://harvest_compression/delta',

    },

    options: {

      resourceFormat: 'v0.0.1',

      gracePeriod: 1000,

      ignoreFromSelf: true,

      optOutMuScopeIds: ['http://redpencil.data.gift/id/concept/muScope/deltas/initialSync'],

    }

  }

```

- Add to your job controller config:

```json

  {

        "currentOperation": "http://lblod.data.gift/id/jobs/concept/TaskOperation/checking-urls",

        "nextOperation": "http://lblod.data.gift/id/jobs/concept/TaskOperation/compressFiles",

        "nextIndex": "9"

  }

```