https://github.com/observingclouds/sgff_nh

https://github.com/observingclouds/sgff_nh

Last synced: 4 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/observingclouds/sgff_nh
• Owner: observingClouds
• Created: 2022-10-14T20:25:33.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2024-04-06T02:08:56.000Z (9 months ago)
• Last Synced: 2024-11-10T11:47:35.738Z (2 months ago)
• Language: Python
• Size: 1.05 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 3
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Neural network classifications of mesoscale patterns of shallow convection

## Access classification products

Some of the classification products are publically hosted. They can be accessed via an intake catalog.

```python

import intake

cat = intake.open_catalog("https://raw.githubusercontent.com/observingClouds/SGFF_NH/main/catalog/catalog.yml")

ds = cat.SGFF_level2.to_dask()

```

This access method always points to the newest version of the dataset. Please make sure to install `intake <2.0.0` as newer versions currently do not support the given catalog format.

## Download repository and data

This repository uses [dvc](dvc.org) to version the data. To work with the recent version of data please execute the following:

```shell

git clone [email protected]:observingClouds/SGFF_NH.git

dvc pull

```

To reproduce results the environment can be created with

```

mamba env create -n sgff -f environment.yml

```

and analysis steps rerun by simply calling

```

dvc repro

```

or

```

dvc repro patterns_along_traj

```

to only reproduce specific steps which are listed in `dvc.yaml`

> [!NOTE]

> Some stages have been frozen to prevent them from being reproduced. Those stages are for example the classification of images or the download of images as they are computationally and/or storagewise very expensive. `dvc repro --force` needs to be used to run those stages or the `frozen: true` in the dvc.yaml needs to be deleted.

## Potential issues

### Error when running stage `stitch_images_TB`

```

convert-im6.q16: width or height exceeds limit `panorama-in.jpg' @ error/cache.c/OpenPixelCache/3802.

```

To solve it you will need to edit `/etc/ImageMagick-6/policy.xml` and increase the limit for memory, width, height and area. For example:

```

  

  

  

  

```

source: https://www.guyrutenberg.com/tag/imagemagick/