https://github.com/coderefinery/meteorological-data-processing-exercise
Example of processing meteorological data for an HPC I/O exercise
https://github.com/coderefinery/meteorological-data-processing-exercise
Last synced: 5 months ago
JSON representation
Example of processing meteorological data for an HPC I/O exercise
- Host: GitHub
- URL: https://github.com/coderefinery/meteorological-data-processing-exercise
- Owner: coderefinery
- License: mit
- Created: 2024-04-11T10:01:26.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-04-11T11:53:30.000Z (about 2 years ago)
- Last Synced: 2025-09-10T04:46:51.041Z (9 months ago)
- Language: Python
- Size: 14.6 KB
- Stars: 0
- Watchers: 6
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Meteorological data processing exercise
Example of processing meteorological data for an HPC I/O exercise
## Running the pipeline:
### 1. Clone the repository
```bash
git clone git@github.com:coderefinery/meteorological-data-processing-exercise.git
cd meteorological-data-processing-exercise
```
### 2. Install dependencies
```bash
pip install -r requirements.txt
```
### 3. Generate example data
```bash
python generate_data.py
```
This generates random temperature measurements from 20 measurement once per
second for each day of a year. This might take a few minutes. Take time to
understand what each script does while it's happening.
### 4. Process the data
```bash
python pipeline.py
```
This step reads in the data for each