{"id":28300444,"url":"https://github.com/pommes-public/pommesdata","last_synced_at":"2025-10-07T21:04:02.118Z","repository":{"id":48165853,"uuid":"383202605","full_name":"pommes-public/pommesdata","owner":"pommes-public","description":"A full-featured transparent data preparation routine from raw data to POMMES model inputs","archived":false,"fork":false,"pushed_at":"2024-04-13T14:58:03.000Z","size":86686,"stargazers_count":2,"open_issues_count":2,"forks_count":2,"subscribers_count":1,"default_branch":"dev","last_synced_at":"2025-09-04T21:44:28.860Z","etag":null,"topics":["data","opensource","power","raw-data","transparent"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/pommes-public.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2021-07-05T16:28:57.000Z","updated_at":"2024-01-15T18:19:44.000Z","dependencies_parsed_at":"2023-02-18T17:01:16.998Z","dependency_job_id":"f6de3f16-0e17-475d-9883-f8b49f71c7bc","html_url":"https://github.com/pommes-public/pommesdata","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/pommes-public/pommesdata","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pommes-public%2Fpommesdata","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pommes-public%2Fpommesdata/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pommes-public%2Fpommesdata/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pommes-public%2Fpommesdata/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/pommes-public","download_url":"https://codeload.github.com/pommes-public/pommesdata/tar.gz/refs/heads/dev","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pommes-public%2Fpommesdata/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":278846437,"owners_count":26056111,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-07T02:00:06.786Z","response_time":59,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data","opensource","power","raw-data","transparent"],"created_at":"2025-05-23T16:22:59.893Z","updated_at":"2025-10-07T21:04:02.112Z","avatar_url":"https://github.com/pommes-public.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# pommesdata\n\n**A full-featured transparent data preparation routine from raw data to POMMES model inputs**\n\nThis is the **data preparation routine** of the fundamental power market model *POMMES* (**PO**wer **M**arket **M**odel of **E**nergy and re**S**ources).\u003cbr\u003e\nPlease navigate to the section of interest to find out more.\n\n## Contents\n* [Introduction](#introduction)\n* [Documentation](#documentation)\n* [Installation and usage](#installation-and-usage)\n* [Contributing](#contributing)\n* [Citing](#citing)\n* [License](#license)\n\n## Introduction\n*POMMES* itself is a cosmos consisting of a **dispatch model**, a **data preparation routine** (stored in this repository and described here) and an **investment model** for the German wholesale power market. The model was originally developed by a group of researchers and students at the [chair of Energy and Resources Management of TU Berlin](https://www.er.tu-berlin.de/menue/home/) and is now maintained by a group of alumni and open for other contributions.\n\nIf you are interested in the actual dispatch or investment model, please find more information here:\n- [pommesdispatch](https://github.com/pommes-public/pommesdispatch): A bottom-up fundamental power market model for the German electricity sector\n- pommesinvest: A multi-period integrated investment and dispatch model for the German power sector (upcoming).\n\n## Documentation\nThe data preparation is mainly carried out in this **[jupyter notebook](https://github.com/pommes-public/pommesdata/blob/dev/pommesdata/data_preparation.ipynb)**.\nThe data sources used as well as the calculation and transformation steps applied are described in a transparent manner.\nIn addition to that, there is a **[documentation of pommesdata](https://pommesdata.readthedocs.io/)** on readthedocs.\nThis in turn contains a documentation of the functions and classes used for data preparation. \n\n## Installation and usage\nThere are **two use cases** for using `pommesdata`:\n1. Using readily prepared output data sets as `pommesdispatch` or `pommesinvest` inputs\n2. Understanding and manipulating the data prep process (inspecting / developing)\n\nIf you are only interested in the readily prepared data sets (option 1), you can obtain\nthem from zenodo and download it here: [https://zenodo.org/](https://zenodo.org/)\n\nIf you are interested in understanding the data preparation process itself or\nif you wish to include own additions, changes or assumptions, you can\n[fork](https://docs.github.com/en/get-started/quickstart/fork-a-repo)\n and then clone the repository, in order to copy the files locally by typing\n\n```\ngit clone https://github.com/pommes-public/pommesdata.git\n```\n\nAfter cloning the repository, you have to install the required dependencies.\nMake sure you have conda installed as a package manager.\nIf not, you can download it [here](https://www.anaconda.com/).\nOpen a command shell and navigate to the folder where you copied the environment to. Use the following command to install dependencies\n\n```\nconda env create -f pommesdata_explicit.yml\n```\nActivate your environment by typing\n```\nconda activate pommesdata_explicit\n```\n\n*Note: Dependencies have not been regularly updated. Thus, use the listed explicit\ndependencies from `pommesdata_explicit.yml` for now and not the `environment.yml` file.*\n\n## Contributing\nEvery kind of contribution or feedback is warmly welcome.\u003cbr\u003e\nWe use the GitHub issue management as well as pull requests for collaboration. \n\nWe try to stick to the PEP8 coding standards.\n\nThe jupyter notebook for the data preparation does not (necessarily have to) \nmeet PEP8 standards, though readability should be made sure.\n\n### Authors\n* Authors of `pommesdata` are Johannes Kochems and Yannick Werner. It is maintained by Johannes Kochems.\n* Florian Maurer contributed to the source code by providing a bug fix.\n* All people mentioned below contributed to early-stage versions or predecessors of POMMES or ideally supported it.\n\n### List of contributors to POMMES\nThe following people have contributed to *POMMES*.\nMost of these contributions belong to early-stage versions and are not part\nof the actual source code. Nonetheless, all contributions shall be acknowledged and the full list is provided for transparency reasons.\n\nThe main contributors are stated on top, the remainder\nis listed in alphabetical order.\n\n| Name                                       | Contribution                                                                                                                                                                                                                                                                                         |\n|--------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|\n| Johannes Kochems                           | major development \u0026 conceptualization\u003cbr\u003econceptualization, development of all investment-related parts; development of main data preparation routines (esp. future projection for all components, RES tender data and LCOE estimates, documentation), architecture, publishing process, maintenance |\n| Yannick Werner                             | major development \u0026 conceptualization\u003cbr\u003econceptualization, development of main data preparation routines (status quo data for all components, detailed RES, interconnector and hydro data), architecture                                                                                            |\n| Benjamin Grosse                            | data collection for conventional power plants in early development stage, ideal support and conceptionel counseling                                                                                                                                                                                  |\n| Carla Spiller                              | data collection for conventional power plants in early stage development as an input to *pommesdata*; co-development of rolling horizon dispatch modelling in predecessor of *pommesdispatch*                                                                                                        |\n| Christian Fraatz                           | data collection for conventional power plants in early stage development as an input to *pommesdata*                                                                                                                                                                                                 |\n| Conrad Nicklisch                           | data collection for RES in early stage development as an input to *pommesdata*                                                                                                                                                                                                                       |\n| Daniel Peschel                             | data collection on CHP power plants as an input to *pommesdata*                                                                                                                                                                                                                                      |\n| Dr. Johannes Giehl                         | conceptionel support and research of data licensing; conceptionel support for investment modelling in *pommesinvest*                                                                                                                                                                                 |\n| Dr. Paul Verwiebe                          | development of small test models as a predecessor of POMMES                                                                                                                                                                                                                                          |\n| Fabian Büllesbach                          | development of a predecessor of the rolling horizon modeling approach in *pommesdispatch*                                                                                                                                                                                                            |\n| Flora von Mikulicz-Radecki                 | extensive code and functionality testing in an early development stage for predecessors of *pommesdispatch* and *pommesinvest*                                                                                                                                                                       |\n| Florian Maurer                             | support with / fix for python dependencies                                                                                                                                                                                                                                                           |\n| Hannes Kachel                              | development and analysis of approaches for complexity reduction in a predecessor of *pommesinvest*                                                                                                                                                                                                   |\n| Julian Endres                              | data collection for costs and conventional power plants in early stage development                                                                                                                                                                                                                   |\n| Julien Faist                               | data collection for original coal power plant shutdown and planned installation of new power plants for *pommesdata*; co-development of a predecessor of *pommesinvest*                                                                                                                              |\n| Leticia Encinas Rosa                       | ata collection for conventional power plants in early stage development as an input to *pommesdata*                                                                                                                                                                                                  |\n| Prof. Dr.-Ing. Joachim Müller-Kirchenbauer | funding, enabling and conceptual support                                                                                                                                                                                                                                                             |\n| Robin Claus                                | data collection for RES in early stage development as an input to *pommesdata*                                                                                                                                                                                                                       |\n| Sophie Westphal                            | data collection for costs and conventional power plants in early stage development as an input for *pommesdata*                                                                                                                                                                                      |\n| Timona Ghosh                               | data collection for interconnector data as an input to *pommesdata*                                                                                                                                                                                                                                  |\n\n## Citing\nData sets created with `pommesdata` are shared at [zenodo](https://zenodo.org).\nIf you use these, please refer to the citation information given at zenodo.\n\nIf you are using `pommesdata` for your own analyses, we recommend citing as:\u003cbr\u003e\n*Kochems, J. \u0026 Wener, Y. (2024): pommesdata. A full-featured transparent data preparation routine from raw data to POMMES model inputs. https://github.com/pommes-public/pommesdata, accessed YYYY-MM-DD.*\n\nWe furthermore recommend naming the version tag or the commit hash used for the sake of transparency and reproducibility.\n\nAlso see CITATION.cff for citation information. Licensing information stated\nin the CITATION.cff is only applicable for the code itself, see \n[license](#License).\n\n## License\nLicensing for the code - in the following referred to as software - \nand the input data used differs. For the licensing of the data, \nplease see the detailed list of data sets below.\n\n### Software (code)\n\nCopyright 2024 pommes developer group\n\nPermission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the \"Software\"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:\n\nThe above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.\n\nTHE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.\n\n### Data (input data)\nThe following table contains the primary data sources used to create data sets used for *POMMES* models.\nThe licensing of the different sources differs and the table should provide an overview over the licences used.\nThus, we cannot publish all the data under an open license, such as a Creative Commons Attribution license. Please\nbe aware that some data might be subject to copyright.\n\n| institution | data set | license | download link |\n| ---- | ---- | ---- | ---- |\n| OPSD | data package conventional power plants | MIT License for software; for dataset-specific license see hyperlink | https://doi.org/10.25832/conventional_power_plants/2018-12-20 \n| ÜNB / BNetzA | power plant list | free to use, license-free according to §5 Abs. 1 UrhG | https://www.netzentwicklungsplan.de/sites/default/files/paragraphs-files/Kraftwerksliste_%C3%9CNB_Entwurf_Szenariorahmen_2030_V2019_2_0_0.pdf\n| FZJ / KIT / FIAS | FRESNA (PyPSA-EUR) PP matching | GPLv3 for software, for dataset-specific license see hyperlink | https://doi.org/10.5281/zenodo.3358985\n| tmrowco | bidding zone geometries | MIT License | https://github.com/tmrowco/electricitymap-contrib/pull/1383\n| UBA | new-built power plants | usage of data accordant to § 12a EGovG permitted | https://www.umweltbundesamt.de/sites/default/files/medien/384/bilder/dateien/4_tab_genehmigte-in_genehmigung-kraftwerksprojekte_2019-04-04.pdf\n| BDEW | new-built power plants | All rights reserved | https://www.bdew.de/media/documents/PI_20190401_BDEW-Kraftwerksliste.pdf\n| BNetzA | new-built \u0026 decommissioned power plants | free to use, license-free according to §5 Abs. 1 UrhG | https://www.bundesnetzagentur.de/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/Versorgungssicherheit/Erzeugungskapazitaeten/Kraftwerksliste/kraftwerksliste-node.html\n| Energie SaarLorLux | new-built power plant | All rights reserved | https://www.energie-saarlorlux.com/unternehmen/mehr-gutes-klima/unsere-co2-projekte/\n| ENTSOE | new-built power plants | CC BY 4.0 | https://tyndp.entsoe.eu/maps-data\n| BNetzA | threshold for new-built power plants | free to use, license-free according to §5 Abs. 1 UrhG | https://www.bundesnetzagentur.de/SharedDocs/Downloads/DE/Sachgebiete/Energie/Unternehmen_Institutionen/Versorgungssicherheit/Berichte_Fallanalysen/BNetzA_Netzstabilitaetsanlagen13k.pdf?__blob=publicationFile\u0026v=3\n| DIW | efficiency estimates for power plants | All rights reserved | https://www.diw.de/documents/publikationen/73/diw_01.c.440963.de/diw_datadoc_2014-072.pdf\n| BNetzA | power plants shutdown | free to use, license-free according to §5 Abs. 1 UrhG | https://www.bundesnetzagentur.de/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/Versorgungssicherheit/Erzeugungskapazitaeten/KWSAL/KWSAL\n| juris | nuclear power plants shutdown | free to use, license-free according to §5 Abs. 1 UrhG | https://www.gesetze-im-internet.de/atg/\n| juris | coal power plants shutdown | free to use, license-free according to §5 Abs. 1 UrhG | https://www.gesetze-im-internet.de/kvbg/index.html\n| KWSB | coal power plants shutdown | CC BY-ND 3.0 DE | https://www.bmwi.de/Redaktion/DE/Downloads/A/abschlussbericht-kommission-wachstum-strukturwandel-und-beschaeftigung.pdf?__blob=publicationFile\n| ENTSOE | Actual Generation per Generation Unit | Use pursuant to Article 5 of the Terms \u0026 Conditions of ENTSO-E; data owned by the specific TSOs |  https://transparency.entsoe.eu/generation/r2/actualGenerationPerGenerationUnit/show\n| ENTSOE | Water Reservoirs and Hydro Storage Plants | Use pursuant to Article 5 of the Terms \u0026 Conditions of ENTSO-E; data owned by the specific TSOs | https://transparency.entsoe.eu/generation/r2/waterReservoirsAndHydroStoragePlants/show\n| ENTSOE | Actual Generation per Production Type | Use pursuant to Article 5 of the Terms \u0026 Conditions of ENTSO-E; data owned by the specific TSOs | https://transparency.entsoe.eu/generation/r2/actualGenerationPerGenerationUnit/show\n| UBA | specific emission factors | Use pursuant to § 12a EGovG for pre-calculations | https://www.umweltbundesamt.de/publikationen/entwicklung-der-spezifischen-kohlendioxid-6\n| OPSD | time series data | MIT License for software; for dataset-specific license see hyperlink | https://data.open-power-system-data.org/time_series/2020-10-06\n| ÜNB | Anlagenstammdaten | data owned by the German TSO | https://www.netztransparenz.de/EEG/Anlagenstammdaten\n| ÜNB | EEG-Bewegungsdaten zur Jahresabrechnung 2017 | data owned by the German TSO | https://www.netztransparenz.de/EEG/Jahresabrechnungen\n| IRENA | installed RES capacities | All rights reserved, data used for pre-calculations | https://www.irena.org/Statistics/Download-Data\n| ENTSO-E | Installed Capacity per Production Type | Use pursuant to Article 5 of the Terms \u0026 Conditions of ENTSO-E; data owned by the specific TSOs | https://transparency.entsoe.eu/generation/r2/installedGenerationCapacityAggregation/show\n| Prognos et al. | study on RES capacities for DE | All rights reserved, data used for pre calculations | https://www.agora-energiewende.de/veroeffentlichungen/klimaneutrales-deutschland/\n| BNetzA | RES tender results solarPV | free to use, license-free according to §5 Abs. 1 UrhG | https://www.bundesnetzagentur.de/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/Versorgungssicherheit/Erzeugungskapazitaeten/Kraftwerksliste/kraftwerksliste-node.html\n| BNetzA | RES tender results wind onshore | free to use, license-free according to §5 Abs. 1 UrhG | https://www.bundesnetzagentur.de/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/Ausschreibungen/Wind_Onshore/BeendeteAusschreibungen/BeendeteAusschreibungen_node.html\n| BNetzA | RES tender results common tenders | free to use, license-free according to §5 Abs. 1 UrhG | https://www.bundesnetzagentur.de/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/Ausschreibungen/Wind_Onshore/BeendeteAusschreibungen/BeendeteAusschreibungen_node.html\n| BNetzA | RES tender results offshore | free to use, license-free according to §5 Abs. 1 UrhG | https://www.bundesnetzagentur.de/DE/Service-Funktionen/Beschlusskammern/1_GZ/BK6-GZ/2017/BK6-17-001/Ergebnisse_erste_Ausschreibung.pdf?__blob=publicationFile\u0026v=3\n| BNetzA | RES tender results offshore | free to use, license-free according to §5 Abs. 1 UrhG | https://www.bundesnetzagentur.de/DE/Service-Funktionen/Beschlusskammern/1_GZ/BK6-GZ/2018/BK6-18-001/Ergebnisse_zweite_ausschreibung.pdf?__blob=publicationFile\u0026v=3\n| BNetzA | solarPV installations (and remuneration) | free to use, license-free according to §5 Abs. 1 UrhG | https://www.bundesnetzagentur.de/DE/Sachgebiete/ElektrizitaetundGas/Unternehmen_Institutionen/ErneuerbareEnergien/ZahlenDatenInformationen/EEG_Registerdaten/ArchivDatenMeldgn/ArchivDatenMeldgn_node.html\n| ÜNB | capacity balance | All rights reserved, data used for pre-calculations | https://www.netztransparenz.de/portals/1/Bericht_zur_Leistungsbilanz_2019.pdf\n| DIW | fuel costs uranium 2017 | All rights reserved | https://www.diw.de/documents/publikationen/73/diw_01.c.440963.de/diw_datadoc_2014-072.pdf\n| DIW | operation costs | All rights reserved | https://www.diw.de/documents/publikationen/73/diw_01.c.440963.de/diw_datadoc_2014-072.pdf\n| Öko Institut | fuel costs lignite 2017 | All rights reserved |  https://www.oeko.de/oekodoc/1995/2014-015-de.pdf\n| Destatis | fuel costs hardcoal 2017 | CC BY 2.0 DE | https://www-genesis.destatis.de/genesis/online?\u0026sequenz=tabelleErgebnis\u0026selectionname=43511-0001#abreadcrumb\n| BAFA | fuel costs natural gas 2017 | CC BY-ND 3.0 DE | https://www.bafa.de/SharedDocs/Downloads/DE/Energie/egas_aufkommen_export_1991.html\n| BMWI | fuel costs heating oil 2017 | CC BY-ND 3.0 DE | https://www.bmwi.de/Redaktion/DE/Artikel/Energie/energiedaten-gesamtausgabe.html\n| r2b | transport costs | CC BY-ND 3.0 DE | https://www.bmwi.de/Redaktion/DE/Publikationen/Studien/definition-und-monitoring-der-versorgungssicherheit-an-den-europaeischen-strommaerkten.pdf?__blob=publicationFile\u0026v=18\n| Fraunhofer ISI | operation costs | All rights reserved | https://www.ise.fraunhofer.de/content/dam/ise/de/documents/publications/studies/DE2018_ISE_Studie_Stromgestehungskosten_Erneuerbare_Energien.pdf\n\n### Prepared data sets (data sets created with *pommesdata*)\nThe data is provided with no license. Please refer to the above licensing information.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpommes-public%2Fpommesdata","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpommes-public%2Fpommesdata","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpommes-public%2Fpommesdata/lists"}