Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/maja601/EuroCrops
The official repository for the EuroCrops dataset.
https://github.com/maja601/EuroCrops
agriculture dataset deep-learning machine-learning opendata sentinel-2
Last synced: about 1 month ago
JSON representation
The official repository for the EuroCrops dataset.
- Host: GitHub
- URL: https://github.com/maja601/EuroCrops
- Owner: maja601
- License: cc-by-sa-4.0
- Created: 2021-08-20T08:11:28.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2024-02-14T09:51:26.000Z (10 months ago)
- Last Synced: 2024-10-29T19:40:00.526Z (about 2 months ago)
- Topics: agriculture, dataset, deep-learning, machine-learning, opendata, sentinel-2
- Language: Jupyter Notebook
- Homepage:
- Size: 1.67 MB
- Stars: 167
- Watchers: 14
- Forks: 23
- Open Issues: 11
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- open-sustainable-technology - EuroCrops - A dataset collection combining all publicly available self-declared crop reporting datasets from countries of the European Union. (Consumption / Agriculture and Nutrition)
README
_Border Region Austria - Slovakia around Bratislava_
# EuroCrops
[](https://creativecommons.org/licenses/by-sa/4.0/)
EuroCrops is a dataset collection combining all publicly available self-declared crop reporting datasets from countries of the European Union.
The project is funded by the German Space Agency at DLR on behalf of the Federal Ministry for Economic Affairs and Climate Action (BMWK).
This work is licensed under a
[Creative Commons Attribution-ShareAlike 4.0 International License][cc-by-sa].
Right now EuroCrops only includes vector data, but stay tuned for a version that includes satellite imagery!
**For any questions, please refer to our [FAQs](https://github.com/maja601/EuroCrops/wiki/FAQs) or use the Discussions/Issues to reach out to us.**
***
## Content
1. [Background](#background)
2. [Hamonisation with HCAT](#harmonsiation)
3. [Participating countries](#participating_countries)
4. [GitHub project structure](#github_structure)
5. [Vector data download via zenodo](#vectordata_zenodo)
6. [Vector data download via Sync&Share (old)](#vectordata)
7. [Reference](#reference)
***
## Background
**Disclaimer**: The *Nomenclature of Territorial Units for Statistics 3 (NUTS3)* region, which we added by hand, is just an approximate assignment of a crop parcel to a region.
It might happen that a parcel is not correctly allocated to the right region or country.
The NUTS3 attribute is only meant to be an aid for a meaningful spatial division of the dataset into training, validation and test sets.
## Hamonisation with HCAT
The raw data obtained from the countries does not come in a unified, machine-readable taxonomy. We, therefore, developed a new **Hierarchical Crop and Agriculture Taxonomy (HCAT)** that harmonises all declared crops across the European Union. In the shapefiles you'll find this as additional attributes:
| Attribute Name | Explanation |
| -------------- | ----------------------------------------------------------- |
| EC_trans_n | The original crop name translated into English |
| EC_hcat_n | The machine-readable HCAT name of the crop |
| EC_hcat_c | The 10-digit HCAT code indicating the hierarchy of the crop |
Find detailed information for all countries of the European Union in our [Wiki](https://github.com/maja601/EuroCrops/wiki), especially the countries represented in EuroCrops:
- [Austria](https://github.com/maja601/EuroCrops/wiki/Austria)
- [Belgium](https://github.com/maja601/EuroCrops/wiki/Belgium)
- [Czechia](https://github.com/maja601/EuroCrops/wiki/Czechia)
- [Germany](https://github.com/maja601/EuroCrops/wiki/Germany)
- [Denmark](https://github.com/maja601/EuroCrops/wiki/Denmark)
- [Estonia](https://github.com/maja601/EuroCrops/wiki/Estonia)
- [Spain](https://github.com/maja601/EuroCrops/wiki/Spain)
- [France](https://github.com/maja601/EuroCrops/wiki/France)
- [Croatia](https://github.com/maja601/EuroCrops/wiki/Croatia)
- [Lithuania](https://github.com/maja601/EuroCrops/wiki/Lithuania)
- [Latvia](https://github.com/maja601/EuroCrops/wiki/Latvia)
- [Netherlands](https://github.com/maja601/EuroCrops/wiki/Netherlands)
- [Portugal](https://github.com/maja601/EuroCrops/wiki/Portugal)
- [Romania](https://github.com/maja601/EuroCrops/wiki/Romania)
- [Sweden](https://github.com/maja601/EuroCrops/wiki/Sweden)
- [Slovenia](https://github.com/maja601/EuroCrops/wiki/Slovenia)
- [Slovakia](https://github.com/maja601/EuroCrops/wiki/Slovakia)
## GitHub project structure
```
├── csvs
│ ├── country_mappings
│ └── [CSV mapping files for all participating countries]
└── hcat_core
└── HCAT.csv
```
## Vector data download via zenodo
The vector data is now available via [zenodo](https://zenodo.org/records/8229128), currently we are on Version 9!
## Vector data download via Sync&Share (only [Version 1](https://zenodo.org/record/6866847))
The shapefiles of the countries are available via [Sync&Share](https://syncandshare.lrz.de/getlink/fiAD95cTrXbnKMrdZYrFFcN8/). Please also make sure to download the data for the countries individually, as there might be some loss otherwise.
```
├── AT
│ └── AT_2021_EC21.*
├── BE
│ └── VLG
│ └── BE_VLG_2021_EC21.*
├── DE
│ ├── LS
│ | └── DE_LS_2021_EC21.*
│ └── NRW
│ └── DE_NRW_2021_EC21.*
├── DK
│ └── DK_2019_EC21.*
├── EE
│ └── EE_2021_EC21.*
├── ES
│ └── NA
│ └── ES_NA_2020_EC21.*
├── FR
│ └── FR_2018_EC21.*
├── HR
│ └── HR_2020_EC21.*
├── LT
│ └── LT_2021_EC.*
├── LV
│ └── LV_2021_EC21.*
├── NL
│ └── NL_2021_EC21.*
├── PT
│ └── PT_2021_EC21.*
├── RO
│ └── RO_ny_EC21.*
├── SE
│ └── SE_2021_EC21.*
├── SI
│ └── SI_2021_EC21.*
└── SK
└── SK_2021_EC21.*
```
**Disclaimer**: Please reference the countries' dependent source in case you're using their data.
```
@Article{schneider2023eurocrops,
title = {{EuroCrops}: {The} {Largest} {Harmonized} {Open} {Crop} {Dataset} {Across} the {European} {Union}},
volume = {10},
copyright = {All rights reserved},
issn = {2052-4463},
url = {https://doi.org/10.1038/s41597-023-02517-0},
doi = {10.1038/s41597-023-02517-0},
number = {1},
journal = {Scientific Data},
author = {Schneider, Maja and Schelte, Tobias and Schmitz, Felix and Körner, Marco},
month = sep,
year = {2023},
pages = {612},
}
```
Additional references:
```
@Misc{schneider2022eurocrops21,
author = {Schneider, Maja and K{\"o}rner, Marco},
title = {EuroCrops},
DOI = {10.5281/zenodo.6866846},
type = {Dataset},
publisher = {Zenodo},
year = {2022}
}
```
```
@InProceedings{Schneider2022Challenges,
title = {Challenges and Opportunities of Large Transnational Datasets: A Case Study on European Administrative Crop Data},
author = {Schneider, Maja and Marchington, Christian and K{\"o}rner, Marco},
booktitle = {Workshop on Broadening Research Collaborations in ML (NeurIPS 2022)},
year = {2022}
}
```
```
@InProceedings{Schneider2022Harnessing,
title = {Harnessing Administrative Data Inventories to Create a Reliable Transnational Reference Database for Crop Type Monitoring},
author = {Schneider, Maja and K{\"o}rner, Marco},
booktitle = {IGARSS 2022-2022 IEEE International Geoscience and Remote Sensing Symposium},
pages = {5385--5388},
year = {2022},
organization = {IEEE}
}
```
```
@InProceedings{Schneider2021EPE,
author = {Schneider, Maja and Broszeit, Amelie and K{\"o}rner, Marco},
booktitle = {Proceedings of the Conference on Big Data from Space (BiDS)},
title = {{EuroCrops}: A Pan-European Dataset for Time Series Crop Type Classification},
editor = {Soille, Pierre and Loekken, Sveinung and Albani, Sergio},
publisher = {Publications Office of the European Union},
date = {2021-05-18},
doi = {10.2760/125905},
eprint = {2106.08151},
eprintclass = {eess.IV,cs.CV,cs.LG},
eprinttype = {arxiv}
}
```
```
@Misc{Schneider2021TEC,
author = {Schneider, Maja and K{\"o}rner, Marco},
date = {2021-06-15},
title = {{TinyEuroCrops}},
doi = {10.14459/2021MP1615987},
organization = {Technical University of Munich (TUM)},
type = {Dataset},
url = {https://mediatum.ub.tum.de/1615987}
}
```
[![CC BY-SA 4.0][cc-by-sa-image]][cc-by-sa]
[cc-by-sa]: http://creativecommons.org/licenses/by-sa/4.0/
[cc-by-sa-image]: https://licensebuttons.net/l/by-sa/4.0/88x31.png
[cc-by-sa-shield]: https://img.shields.io/badge/License-CC%20BY--SA%204.0-lightgrey.svg