{"id":24446396,"url":"https://github.com/openclimatefix/open-data-pvnet","last_synced_at":"2025-10-06T15:30:26.417Z","repository":{"id":267030437,"uuid":"898565981","full_name":"openclimatefix/open-data-pvnet","owner":"openclimatefix","description":"Solar Forecasting using PVNet on Open Data","archived":false,"fork":false,"pushed_at":"2025-01-23T12:30:32.000Z","size":622,"stargazers_count":8,"open_issues_count":17,"forks_count":6,"subscribers_count":4,"default_branch":"main","last_synced_at":"2025-01-23T13:32:28.019Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/openclimatefix.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"github":["openclimatefix"],"patreon":null,"open_collective":"openclimatefix","ko_fi":null,"tidelift":null,"community_bridge":null,"liberapay":null,"issuehunt":null,"otechie":null,"custom":null}},"created_at":"2024-12-04T16:13:43.000Z","updated_at":"2025-01-23T12:30:35.000Z","dependencies_parsed_at":"2024-12-23T16:29:11.588Z","dependency_job_id":"df0afdd1-be3d-49cb-b4dd-8baba308c5cc","html_url":"https://github.com/openclimatefix/open-data-pvnet","commit_stats":null,"previous_names":["openclimatefix/open-data-pvnet"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openclimatefix%2Fopen-data-pvnet","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openclimatefix%2Fopen-data-pvnet/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openclimatefix%2Fopen-data-pvnet/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openclimatefix%2Fopen-data-pvnet/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/openclimatefix","download_url":"https://codeload.github.com/openclimatefix/open-data-pvnet/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":235531156,"owners_count":19004907,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-01-20T23:58:09.804Z","updated_at":"2025-10-06T15:30:26.411Z","avatar_url":"https://github.com/openclimatefix.png","language":"Python","funding_links":["https://github.com/sponsors/openclimatefix","https://opencollective.com/openclimatefix"],"categories":[],"sub_categories":[],"readme":"# 🌞 Open Source Solar Forecasting Project – Volunteers Welcome! 🌞\n\u003c!-- ALL-CONTRIBUTORS-BADGE:START - Do not remove or modify this section --\u003e\n[![All Contributors](https://img.shields.io/badge/all_contributors-7-orange.svg?style=flat-square)](#contributors-)\n\u003c!-- ALL-CONTRIBUTORS-BADGE:END --\u003e\n\n[![ease of contribution: easy](https://img.shields.io/badge/ease%20of%20contribution:%20easy-32bd50)](https://github.com/openclimatefix/ocf-meta-repo?tab=readme-ov-file#how-easy-is-it-to-get-involved)\n\n## Scope\n\nWe're building an open-source solar forecasting pipeline to integrate with the OCF's [PVNet](https://github.com/openclimatefix/pvnet) using publicly available data to predict solar generation at the national level, starting with the UK. Eventually, we aim to achieve **global coverage**! 🌍\n\nTasks include:\n- Identifying gridded Numerical Weather Prediction (NWP) datasets.\n- Downloading and transforming NWP data into the preferred Zarr format.\n- Acquiring solar generation target data via APIs (e.g., PVlive's solar generation and capacity API).\n- Creating pipelines for batching data and ML model experimentation.\n- Deploying the model to the cloud.\n\nWe will begin in the UK to benchmark against OCF results and expand to other countries as the project progresses. 😄\n\n\n### Basic Usage Examples\n```bash\n# Archive Met Office UK data for a specific day in zarr format to Hugging Face\nopen-data-pvnet metoffice archive --year 2023 --month 12 --day 1 --region uk\n\n# Load data for analysis\nopen-data-pvnet metoffice load --year 2023 --month 1 --day 16 --region uk\n\n```\n\nFor detailed usage instructions and examples, see our [Getting Started Guide](docs/getting_started.md#command-line-interface-cli).\n\n## Volunteer Skills/Roles Needed\n\nWe are looking for volunteers with the following skills:\n- **Data Engineers**: For data acquisition, curation,transformation, and storage.\n- **Machine Learning Enthusiasts**: To experiment, train, and evaluate models.\n- **Software Developers**: Especially those with Python expertise.\n- **Cloud Computing Experts**: For deploying and scaling the model.\n- **DevOps Specialists**: To streamline workflows and maintain infrastructure.\n\n---\n\n## Getting Started\n\nReady to dive in? Check out our [Getting Started Guide](docs/getting_started.md#solar-forecasting-volunteer-onboarding) for an introduction to the key concepts and how you can contribute effectively.\n\n### Notebooks\n\n- [Understanding GFS Data](notebooks/understanding_gfs_data.ipynb)\n- [Understanding Met Office data](notebooks/understanding_metoffice_data.ipynb)\n- [GFS Sample Notebook](notebooks/gfs_sample.ipynb)\n---\n\nIf you're passionate about **renewable energy, open-source collaboration, and sustainability**, please join us in advancing solar forecasting solutions for a better future! 🌍☀️✨\n\n## Contributing and community\n\n[![issues badge](https://img.shields.io/github/issues/openclimatefix/open-data-pvnet?color=FFAC5F)](https://github.com/openclimatefix/open-data-pvnet/issues?q=is%3Aissue+is%3Aopen+sort%3Aupdated-desc)\n\n- PR's are welcome! See the [Organisation Profile](https://github.com/openclimatefix) for details on contributing\n- Find out about our other projects in the [here](https://github.com/openclimatefix/.github/tree/main/profile)\n- Check out the [OCF blog](https://openclimatefix.org/blog) for updates\n- Follow OCF on [LinkedIn](https://uk.linkedin.com/company/open-climate-fix)\n\n---\n\n## GitHub Project\nExplore our project board to track progress and tasks: [Open Climate Fix Solar Project Board](https://github.com/orgs/openclimatefix/projects/36)\n\n---\n\n## Contributors ✨\n\nThanks goes to these wonderful people ([emoji key](https://allcontributors.org/docs/en/emoji-key)):\n\n\u003c!-- ALL-CONTRIBUTORS-LIST:START - Do not remove or modify this section --\u003e\n\u003c!-- prettier-ignore-start --\u003e\n\u003c!-- markdownlint-disable --\u003e\n\u003ctable\u003e\n  \u003ctbody\u003e\n    \u003ctr\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://github.com/peterdudfield\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/34686298?v=4?s=100\" width=\"100px;\" alt=\"Peter Dudfield\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003ePeter Dudfield\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#projectManagement-peterdudfield\" title=\"Project Management\"\u003e📆\u003c/a\u003e\u003c/td\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://github.com/Sukh-P\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/42407101?v=4?s=100\" width=\"100px;\" alt=\"Sukhil Patel\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eSukhil Patel\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#projectManagement-Sukh-P\" title=\"Project Management\"\u003e📆\u003c/a\u003e\u003c/td\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://github.com/jcamier\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/14153557?v=4?s=100\" width=\"100px;\" alt=\"Jack Camier\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eJack Camier\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#ideas-jcamier\" title=\"Ideas, Planning, \u0026 Feedback\"\u003e🤔\u003c/a\u003e\u003c/td\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://github.com/alirashidAR\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/110668489?v=4?s=100\" width=\"100px;\" alt=\"Ali Rashid\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eAli Rashid\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/openclimatefix/open-data-pvnet/commits?author=alirashidAR\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://github.com/arzoo0511\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/148741922?v=4?s=100\" width=\"100px;\" alt=\"arzoo0511\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003earzoo0511\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/openclimatefix/open-data-pvnet/commits?author=arzoo0511\" title=\"Documentation\"\u003e📖\u003c/a\u003e\u003c/td\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"https://github.com/MAYANK12SHARMA\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/145884197?v=4?s=100\" width=\"100px;\" alt=\"MAYANK SHARMA\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eMAYANK SHARMA\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"#infra-MAYANK12SHARMA\" title=\"Infrastructure (Hosting, Build-Tools, etc)\"\u003e🚇\u003c/a\u003e\u003c/td\u003e\n      \u003ctd align=\"center\" valign=\"top\" width=\"14.28%\"\u003e\u003ca href=\"http://siddharth7113.github.io\"\u003e\u003cimg src=\"https://avatars.githubusercontent.com/u/114160268?v=4?s=100\" width=\"100px;\" alt=\"Siddharth\"/\u003e\u003cbr /\u003e\u003csub\u003e\u003cb\u003eSiddharth\u003c/b\u003e\u003c/sub\u003e\u003c/a\u003e\u003cbr /\u003e\u003ca href=\"https://github.com/openclimatefix/open-data-pvnet/commits?author=siddharth7113\" title=\"Code\"\u003e💻\u003c/a\u003e\u003c/td\u003e\n    \u003c/tr\u003e\n  \u003c/tbody\u003e\n\u003c/table\u003e\n\n\u003c!-- markdownlint-restore --\u003e\n\u003c!-- prettier-ignore-end --\u003e\n\n\u003c!-- ALL-CONTRIBUTORS-LIST:END --\u003e\n\nThis project follows the [all-contributors](https://github.com/all-contributors/all-contributors) specification. Contributions of any kind welcome!\n\n\n*Part of the [Open Climate Fix](https://github.com/orgs/openclimatefix/people) community.*\n\n[![OCF Logo](https://cdn.prod.website-files.com/62d92550f6774db58d441cca/6324a2038936ecda71599a8b_OCF_Logo_black_trans.png)](https://openclimatefix.org)\n\n## License\n\nThis project is licensed under the [MIT License](LICENSE). See the LICENSE file for details.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopenclimatefix%2Fopen-data-pvnet","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fopenclimatefix%2Fopen-data-pvnet","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopenclimatefix%2Fopen-data-pvnet/lists"}