https://github.com/pcpp94/elexon_pipeline_gb_demand
Guidelines and code snippets for extracting and processing Elexon gross demand data on Databricks. Provides half-hourly GB demand at sectoral (Domestic, Non-domestic), GSP-area granularity, settlement demand, and embedded generation. Supports non-commodity cost calculations for CfD, RO, and FiT.
https://github.com/pcpp94/elexon_pipeline_gb_demand
data electricity elexon gb octopusenergy power powerdata pypsa uk
Last synced: about 2 months ago
JSON representation
Guidelines and code snippets for extracting and processing Elexon gross demand data on Databricks. Provides half-hourly GB demand at sectoral (Domestic, Non-domestic), GSP-area granularity, settlement demand, and embedded generation. Supports non-commodity cost calculations for CfD, RO, and FiT.
- Host: GitHub
- URL: https://github.com/pcpp94/elexon_pipeline_gb_demand
- Owner: pcpp94
- Created: 2024-09-11T23:08:48.000Z (8 months ago)
- Default Branch: main
- Last Pushed: 2024-09-12T01:47:47.000Z (8 months ago)
- Last Synced: 2025-01-26T19:11:13.528Z (3 months ago)
- Topics: data, electricity, elexon, gb, octopusenergy, power, powerdata, pypsa, uk
- Language: Python
- Homepage:
- Size: 272 KB
- Stars: 0
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Elexon Gross Demand ETL Guideline*
*Code snippets from scripts running on Databricks, not complete pipeline. Although all necessary inputs' locations are pointed out.\
*For any further clarifications, contact me at: [email protected]
## Outputs:
- GB Demand at a half-hourly, sectoral (Domestic, Non-domestic), GSP-area (Grid Supply Point) granularity.
- Settlement Demand (measured from final-users consumption).
- Includes Big Demand (Transmission Line connected demand) by Category.
- Embedded Generation at SVA (Suppliers Volume Allocation) level.
- Basis to produce Base Demand Volumes for non-commodity costs: CfD (Contracts for Difference), RO (Renewable Obligations), FiT (Feed in Tariffs).
## Inputs:
#### Elexon Open Dataflows as Inputs: [https://www.elexonportal.co.uk/]
- **P315:** [https://www.elexonportal.co.uk/p315?] "Suppliers' Meter Volume and MPAN counts" (This is SVA demand only) Available through FTP
- P0276: GSP Group Consumption Totals Report.
- P0277: GSP Group Market Matrix Report.
- **P114:** [https://www.elexonportal.co.uk/p114] (SVA and CVA demand) Available through FTP or the APIs below (get API_KEY from https://www.elexonportal.co.uk/)
- SAA-i014: Settlement Reports [`https://downloads.elexonportal.co.uk/p114/list?key=&date=2018-01-17&filter=s0142`]
- SAA-i042: BM Unit Gross Demand Report. [`https://downloads.elexonportal.co.uk/p114/list?key=&date=2018-01-17&filter=c0421`]
#### Elexon MDD (Market Domain Data) Tables as Inputs: [https://www.elexonportal.co.uk/mddviewer/]
- **TLMs:** Transmission Loss Multipliers. [https://www.elexonportal.co.uk/article/view/33407] [https://downloads.elexonportal.co.uk/file/download/TLM_FILE?key=YOUR_SCRIPTING_KEY_FROM_ELEXON_PORTAL]
- **LLFs:** Line Loss Factors. [https://www.elexonportal.co.uk/svallf/] [for bulk downloading/file transfer please contact [email protected]]
- **GCFs:** Grid Correction Factors. [https://www.elexonportal.co.uk/article/view/1796] [www.elexonportal.co.uk/gspgroupcorrectionfactordata]
- **PCs:** Profile Coefficients. [https://www.elexonportal.co.uk/article/view/31709] [www.elexonportal.co.uk/d0018]
#### BMU Dictionaries:
- Classifications by different categories.
- https://bmrs.elexon.co.uk/api-documentation/endpoint/reference/bmunits/all
- https://www.netareports.com/data/elexon/bmu.jsp
#### Notes:
- If you need any bulk download of past data of GCF, TLMs, etc. contact ELEXON (links above).