{"id":13448967,"url":"https://github.com/duncanwp/ClimateBench","last_synced_at":"2025-03-22T18:32:20.943Z","repository":{"id":42436429,"uuid":"393433469","full_name":"duncanwp/ClimateBench","owner":"duncanwp","description":null,"archived":false,"fork":false,"pushed_at":"2024-04-23T00:24:55.000Z","size":35078,"stargazers_count":89,"open_issues_count":4,"forks_count":24,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-03-16T05:51:12.267Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/duncanwp.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-08-06T16:18:21.000Z","updated_at":"2025-01-14T17:40:16.000Z","dependencies_parsed_at":"2024-04-23T01:49:38.903Z","dependency_job_id":null,"html_url":"https://github.com/duncanwp/ClimateBench","commit_stats":{"total_commits":33,"total_committers":6,"mean_commits":5.5,"dds":"0.18181818181818177","last_synced_commit":"085c0b5b20761446fabe05bbc58b9a5440e9c25f"},"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/duncanwp%2FClimateBench","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/duncanwp%2FClimateBench/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/duncanwp%2FClimateBench/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/duncanwp%2FClimateBench/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/duncanwp","download_url":"https://codeload.github.com/duncanwp/ClimateBench/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245002967,"owners_count":20545528,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-07-31T06:00:26.551Z","updated_at":"2025-03-22T18:32:15.920Z","avatar_url":"https://github.com/duncanwp.png","language":"Jupyter Notebook","readme":"# ClimateBench\n\nClimateBench is a benchmark dataset for climate model emulation inspired by [WeatherBench](https://github.com/pangeo-data/WeatherBench). It consists of NorESM2 simulation outputs with associated forcing data processed in to a consistent format from a variety of experiments performed for CMIP6. Multiple ensemble members are included where available. \n\nThe processed training, validation and test data can be obtained from Zenodo: [10.5281/zenodo.5196512](https://doi.org/10.5281/zenodo.5196512).\n\nThe ClimateBench Paper was published in [AGU JAMES](https://agupubs.onlinelibrary.wiley.com/doi/full/10.1029/2021MS002954) on September 2022.\n\n## Leaderboard\n\nThe spatial, global and total NRMSE of the different baseline emulators for the years 2080-2100 against the ClimateBench task of estimating key climate variables under future scenario SSP245. The models  are ranked in order of the mean of the total NRMSE across all tasks. \n\n|                  |   ('tas', 'Spatial') |   ('tas', 'Global') |   ('tas', 'Total') |   ('diurnal_temperature_range', 'Spatial') |   ('diurnal_temperature_range', 'Global') |   ('diurnal_temperature_range', 'Total') |   ('pr', 'Spatial') |   ('pr', 'Global') |   ('pr', 'Total') |   ('pr90', 'Spatial') |   ('pr90', 'Global') |   ('pr90', 'Total') |\n|------------------|----------------------|---------------------|--------------------|--------------------------------------------|-------------------------------------------|------------------------------------------|---------------------|--------------------|-------------------|-----------------------|----------------------|---------------------|\n| Neural Network   |             0.107294 |           0.0440271 |           0.327429 |                                    9.91735 |                                   1.37219 |                                  16.7783 |             2.1281  |           0.2093   |           3.1746  |               2.61022 |             0.345709 |             4.33876 |\n| Gaussian Process |             0.109106 |           0.0738238 |           0.478225 |                                    9.20713 |                                   2.67495 |                                  22.5819 |             2.34092 |           0.341453 |           4.04818 |               2.5559  |             0.429154 |             4.70167 |\n| Random Forest    |             0.107574 |           0.0584057 |           0.399602 |                                    9.19503 |                                   2.65241 |                                  22.4571 |             2.52431 |           0.502126 |           5.03494 |               2.68209 |             0.543375 |             5.39896 |\n\n\n## Installation\nThe example scripts provided here require [ESEm](https://github.com/duncanwp/ESEm) and a few other packages. It is recommended to first create a conda environment with iris or xarray::\n\n    $ conda install -c conda-forge iris\n\nThen pip install the additional requirements:\n\n    $ pip install esem[gpflow,keras,scikit-learn] eofs\n\n","funding_links":[],"categories":["Datasets","Domain-Specific Resources","🔬 Domain-Specific Applications"],"sub_categories":["✨Benchmarks","Climate \u0026 Environmental Science","🌍 Earth \u0026 Climate Science"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fduncanwp%2FClimateBench","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fduncanwp%2FClimateBench","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fduncanwp%2FClimateBench/lists"}