{"id":24610962,"url":"https://github.com/scilifelabdatacentre/dc-dynamic","last_synced_at":"2025-03-18T14:44:42.661Z","repository":{"id":39886813,"uuid":"340373872","full_name":"ScilifelabDataCentre/dc-dynamic","owner":"ScilifelabDataCentre","description":null,"archived":false,"fork":false,"pushed_at":"2024-03-05T08:51:56.000Z","size":98,"stargazers_count":2,"open_issues_count":0,"forks_count":1,"subscribers_count":7,"default_branch":"master","last_synced_at":"2024-03-05T09:53:17.131Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ScilifelabDataCentre.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2021-02-19T13:14:40.000Z","updated_at":"2024-04-15T09:36:46.093Z","dependencies_parsed_at":"2024-03-05T09:47:33.325Z","dependency_job_id":"f19515a7-3d85-471a-9d8e-62fa3e93a00f","html_url":"https://github.com/ScilifelabDataCentre/dc-dynamic","commit_stats":null,"previous_names":[],"tags_count":25,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ScilifelabDataCentre%2Fdc-dynamic","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ScilifelabDataCentre%2Fdc-dynamic/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ScilifelabDataCentre%2Fdc-dynamic/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ScilifelabDataCentre%2Fdc-dynamic/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ScilifelabDataCentre","download_url":"https://codeload.github.com/ScilifelabDataCentre/dc-dynamic/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244244911,"owners_count":20422406,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-01-24T19:19:51.772Z","updated_at":"2025-03-18T14:44:42.632Z","avatar_url":"https://github.com/ScilifelabDataCentre.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"DC dynamic\n==========\n\nThis repository contains scripts to be run as cron jobs.\n\n`ACCESS_KEY` should be set for the container, defining the access key to use for Blobserver.\n\nNo persistent storage is provided, so any generated files should be uploaded somewhere to be saved.\n\n### cron run every 10 minutes\n\n#### freya_runner_every10mins.sh\n\nRuns the scripts created by team Freya on `*/10 * * * *` (Every ten minutes)\n\nAny files put in `$CODE_PATH/output` will be uploaded to Blobserver using the dc-dynamic account.\n\n### cron run hourly\n\n#### slack_runner_hourly.sh\n\nRuns the script `slack_feeds.py` on `40 * * * *` (Every hour at 40th minute)\n\n**slack_feeds.py** - Script to post message about new feeds (events/jobs) on SciLifeLab web to configured slack channel\n\n### cron run daily\n\n#### freya_runner_daily.sh\n\nRuns the script created by team Freya on `0 7 * * *` (07:00 GMT).\n\nAny files put in `$CODE_PATH/output` will be uploaded to Blobserver using the dc-dynamic account.\n\n#### slack_runner_daily.sh\n\nRuns the script `slack_figshare.py` on `0 6 * * *` (06:00 GMT)\n\n**slack_figshare.py** - Script to post message about new items in figshare to configured slack channel\n\n### cron run weekly\n\n#### freya_runner_weekly.sh\n\nRuns the script created by team Freya on `0 4 * * 5 ` (04:00 GMT every Friday morning).\n\nAny files put in `$CODE_PATH/output` will be uploaded to Blobserver using the dc-dynamic account.\n\n\n## Adding jobs\n\nAdd new commands to the above files to have them running on schedule. If you need jobs to run on a different schedule, talk to Sys admins or team Freya.\n\nMake sure that the `requirements.txt` file in dc-dynamic contains all modules required for the native scripts (i.e. residing in dc-dynamic repo) **and** that any changes do not break the current code.\n\n### Uploading files\n\nTh easiest way to upload files is to use curl:\n\n```bash\ncurl \"https://blobserver.dc.scilifelab.se/blob/$filename\" -H \"x-accesskey: $ACCESS_KEY\" --upload-file \"$filename\"\n```\n\nFeel free to set new variables, but remember to tell Sys admins or team Freya if you need them to be set for the cronjobs on the cluster.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fscilifelabdatacentre%2Fdc-dynamic","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fscilifelabdatacentre%2Fdc-dynamic","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fscilifelabdatacentre%2Fdc-dynamic/lists"}