{"id":21881561,"url":"https://github.com/pcpp94/elexon_pipeline_gb_demand","last_synced_at":"2025-07-12T03:16:29.102Z","repository":{"id":256676312,"uuid":"856057019","full_name":"pcpp94/elexon_pipeline_GB_demand","owner":"pcpp94","description":"Guidelines and code snippets for extracting and processing Elexon gross demand data on Databricks. Provides half-hourly GB demand at sectoral (Domestic, Non-domestic), GSP-area granularity, settlement demand, and embedded generation. Supports non-commodity cost calculations for CfD, RO, and FiT.","archived":false,"fork":false,"pushed_at":"2024-09-12T01:47:47.000Z","size":279,"stargazers_count":0,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-22T00:44:50.516Z","etag":null,"topics":["data","electricity","elexon","gb","octopusenergy","power","powerdata","pypsa","uk"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/pcpp94.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-09-11T23:08:48.000Z","updated_at":"2024-10-26T07:59:36.000Z","dependencies_parsed_at":"2024-09-12T11:39:55.833Z","dependency_job_id":"8932b63f-a1b2-4e50-9226-ac455fc8dbf9","html_url":"https://github.com/pcpp94/elexon_pipeline_GB_demand","commit_stats":null,"previous_names":["pcpp94/elexon_pipeline_gb_demand"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/pcpp94/elexon_pipeline_GB_demand","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pcpp94%2Felexon_pipeline_GB_demand","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pcpp94%2Felexon_pipeline_GB_demand/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pcpp94%2Felexon_pipeline_GB_demand/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pcpp94%2Felexon_pipeline_GB_demand/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/pcpp94","download_url":"https://codeload.github.com/pcpp94/elexon_pipeline_GB_demand/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pcpp94%2Felexon_pipeline_GB_demand/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":260114243,"owners_count":22960859,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data","electricity","elexon","gb","octopusenergy","power","powerdata","pypsa","uk"],"created_at":"2024-11-28T09:19:30.694Z","updated_at":"2025-06-16T06:31:54.640Z","avatar_url":"https://github.com/pcpp94.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Elexon Gross Demand ETL Guideline*\n*Code snippets from scripts running on Databricks, not complete pipeline. Although all necessary inputs' locations are pointed out.\\\n*For any further clarifications, contact me at: pcparedesp@hotmail.com\n\n## Outputs:\n- GB Demand at a half-hourly, sectoral (Domestic, Non-domestic), GSP-area (Grid Supply Point) granularity.\n  - Settlement Demand (measured from final-users consumption).\n  - Includes Big Demand (Transmission Line connected demand) by Category.\n  - Embedded Generation at SVA (Suppliers Volume Allocation) level.\n  - Basis to produce Base Demand Volumes for non-commodity costs: CfD (Contracts for Difference), RO (Renewable Obligations), FiT (Feed in Tariffs).\n\n## Inputs:\n\n#### Elexon Open Dataflows as Inputs: [https://www.elexonportal.co.uk/]\n- **P315:** [https://www.elexonportal.co.uk/p315?] \"Suppliers' Meter Volume and MPAN counts\" (This is SVA demand only)  Available through FTP\n  - P0276: GSP Group Consumption Totals Report.\n  - P0277: GSP Group Market Matrix Report.\n- **P114:** [https://www.elexonportal.co.uk/p114] (SVA and CVA demand) Available through FTP or the APIs below (get API_KEY from https://www.elexonportal.co.uk/)\n  - SAA-i014: Settlement Reports [`https://downloads.elexonportal.co.uk/p114/list?key=\u003cAPI_KEY\u003e\u0026date=2018-01-17\u0026filter=s0142`]\n  - SAA-i042: BM Unit Gross Demand Report. [`https://downloads.elexonportal.co.uk/p114/list?key=\u003cAPI_KEY\u003e\u0026date=2018-01-17\u0026filter=c0421`]\n\n#### Elexon MDD (Market Domain Data) Tables as Inputs: [https://www.elexonportal.co.uk/mddviewer/]\n- **TLMs:** Transmission Loss Multipliers. [https://www.elexonportal.co.uk/article/view/33407] [https://downloads.elexonportal.co.uk/file/download/TLM_FILE?key=YOUR_SCRIPTING_KEY_FROM_ELEXON_PORTAL]\n- **LLFs:** Line Loss Factors. [https://www.elexonportal.co.uk/svallf/] [for bulk downloading/file transfer please contact llfs@elexon.co.uk]\n- **GCFs:** Grid Correction Factors. [https://www.elexonportal.co.uk/article/view/1796] [www.elexonportal.co.uk/gspgroupcorrectionfactordata]\n- **PCs:** Profile Coefficients. [https://www.elexonportal.co.uk/article/view/31709] [www.elexonportal.co.uk/d0018]\n\n#### BMU Dictionaries:\n- Classifications by different categories.\n  - https://bmrs.elexon.co.uk/api-documentation/endpoint/reference/bmunits/all\n  - https://www.netareports.com/data/elexon/bmu.jsp\n\n#### Notes:\n- If you need any bulk download of past data of GCF, TLMs, etc. contact ELEXON (links above).","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpcpp94%2Felexon_pipeline_gb_demand","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpcpp94%2Felexon_pipeline_gb_demand","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpcpp94%2Felexon_pipeline_gb_demand/lists"}