{"id":31565701,"url":"https://github.com/correlaid/cdl-selbstlernmaterial","last_synced_at":"2025-10-05T07:15:32.785Z","repository":{"id":287915953,"uuid":"956090271","full_name":"CorrelAid/cdl-selbstlernmaterial","owner":"CorrelAid","description":"Content and Tooling for CDL Selbstlernmaterial","archived":false,"fork":false,"pushed_at":"2025-05-20T15:30:27.000Z","size":610,"stargazers_count":0,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-05-20T16:45:06.334Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"R","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/CorrelAid.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE_CODE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-03-27T17:21:54.000Z","updated_at":"2025-05-20T15:30:36.000Z","dependencies_parsed_at":"2025-05-20T16:36:46.531Z","dependency_job_id":"ecd37df9-cd86-4c8b-964e-7a2afcc89986","html_url":"https://github.com/CorrelAid/cdl-selbstlernmaterial","commit_stats":null,"previous_names":["correlaid/cdl-selbstlernmaterial"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/CorrelAid/cdl-selbstlernmaterial","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CorrelAid%2Fcdl-selbstlernmaterial","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CorrelAid%2Fcdl-selbstlernmaterial/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CorrelAid%2Fcdl-selbstlernmaterial/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CorrelAid%2Fcdl-selbstlernmaterial/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/CorrelAid","download_url":"https://codeload.github.com/CorrelAid/cdl-selbstlernmaterial/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CorrelAid%2Fcdl-selbstlernmaterial/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":278421654,"owners_count":25984054,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-05T02:00:06.059Z","response_time":54,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-10-05T07:15:31.082Z","updated_at":"2025-10-05T07:15:32.779Z","avatar_url":"https://github.com/CorrelAid.png","language":"R","funding_links":[],"categories":[],"sub_categories":[],"readme":"# CDL Selbstlernmaterial \n\n## Content\n### License\n[![License: CC BY 4.0](https://img.shields.io/badge/License-CC%20BY%204.0-lightgrey.svg)](https://creativecommons.org/licenses/by/4.0/deed.de)\n\nSee `LICENSE_CONTENT` for details for each page.\n\n## Tooling / Code\n\n [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n\n\nThis repository provides the code + pipeline to:\n\n1. download the Google Docs for each author\n2. convert them to markdown\n3. extract the individual pages / tabs for each term\n4. clean the content\n5. upload the data to google sheets\n\n\n### Setup\n\ninstall packages with `renv`.\n\n```r\ninstall.packages(\"renv\")\nrenv::restore()\n```\n\n### Requirements\nThe following files that are not checked into this repository are needed to run the pipeline:\n\n`.slackr-slm-list` (see slackr package documentation)\n\n```\ntoken: token\nincoming_webhook_url: webhook url\nicon_emoji: can be empty\nusername: slackr\nchannel: #a-channel\n```\n\n`.env`\n\n```\nSLACK_TOKEN=\"same slack token as in slackr file\"\nSLACK_LIST_FILEID=\"id of Slack List (kanban board)\"\nUSE_MARKDOWN_STRICT=1 # or 0\nUPLOAD_SHEET=\"google sheets url\"\nGDRIVE_SHARED=\"shared drive name where google docs reside\"\nDOC_PREFIX=\"common prefix of google docs - for searching\"\n```\n\n`data/meta/authors.csv`: used to match from Slack List to names to use for the CC-BY License\n\n```\nemail, name\nmax.musterperson@email.de, Max Musterperson\n```\n\n\n## Run\n\nThe R files are to be run sequentially, indicated per their number prefix.\n\nYou can run `pipeline.R` to execute them in the right order or run them individually.\n\nYou can also use `make` to resolve dependencies in a more elegant and efficient way:\n\n```\nmake upload\n```\nThis does not automatically re-download the Google docs and the Slack Kanban board. To do so: \n\n```\nmake download-gdocs # optional\nmake download-kanban # optional\nmake upload\n```\n\n\nintermediate targets - again, those do not automatically download their online dependencies. This has to be done using the targets `download-gdocs` respectively `download-kanban`\n\n```\n# make download-gdocs \nmake data/md/\n```\n\n```\nmake download-gdocs # optional\nmake download-kanban # optional\nmake data/md_upload/\n```","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcorrelaid%2Fcdl-selbstlernmaterial","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcorrelaid%2Fcdl-selbstlernmaterial","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcorrelaid%2Fcdl-selbstlernmaterial/lists"}