https://github.com/worldhealthorganization/xform-covid-casecount-who

Data transformer for COVID-19 case counts from WHO
https://github.com/worldhealthorganization/xform-covid-casecount-who

case-counts covid19 eios who xform

Last synced: about 1 month ago
JSON representation

Data transformer for COVID-19 case counts from WHO

• Host: GitHub
• URL: https://github.com/worldhealthorganization/xform-covid-casecount-who
• Owner: WorldHealthOrganization
• Created: 2020-09-28T22:19:47.000Z (about 4 years ago)
• Default Branch: master
• Last Pushed: 2024-02-09T09:02:11.000Z (11 months ago)
• Last Synced: 2024-02-09T10:24:09.826Z (11 months ago)
• Topics: case-counts, covid19, eios, who, xform
• Language: Makefile
• Homepage:
• Size: 118 MB
• Stars: 2
• Watchers: 6
• Forks: 1
• Open Issues: 7
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Transformer Template Project

## About

This is a template project for creating data transformers that can be registered with the [Data Registry](https://github.com/WorldHealthOrganization/covid-data-registry).

The workflow for transformation is managed via [GitHub Actions](https://github.com/features/actions).

## Usage

1. From the repo GitHub page click the "Use this template" button to create a new repo for your transformer.

2. Search the repo for `TODO` and make the appropriate changes for your transformer.

3. Update xform.yml to provide metadata for the data source and outputs.

4. Update this README file with relevant information about the data source.

## Development

There are three primary files that can be changed for your specific needs:

1. [xform.sh](src/xform.sh)

   - This script handles installing dependencies and executing your transformer. 

2. [install.sh](src/install.sh) 

   - This script can be used to install additional dependencies that your transformer requires.

   - This file can be deleted if it's not needed.

3. [xform.R](src/xform.R)

   - This is the default transformer file.

   - This file can be deleted or replaced with code for any other programming language. You will need to update [xform.sh](src/xform.sh) to call your new code if not using R. 

To schedule your transformer in GitHub Actions you will need to uncomment the scheduling section in [.github/workflows/main.yml](.github/workflows/main.yml).

Search the codebase for `TODO` to find additional items that may need to be configured for your instance.

## Testing

Each action runs in its own Docker container in GitHub Actions and locally for testing.

Each action has its own Makefile with common commands to run and test each step of the workflow.

The main [Makefile](Makefile) has commands for executing each action.

Primary Commands:

- `make run-workflow`

  - Runs the xform, CSV validation, and git-push.

  - Running locally via docker-compose does not commit and push. Edit [.github/actions/git-push/docker-compose.yml](.github/actions/git-push/docker-compose.yml) to modify this behaviour if needed.

- `make run-xform`

  - Run the xform.

- `make run-validate-csv`

  - The the CSV validation.

- `make run-git-push`

  - Run git push.

See [Makefile](Makefile) for all commands and each individual Makefile in the [actions](.github/actions) folders.