Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/blutjens/awesome-forests
🌳 A curated list of ground-truth forest datasets for the machine learning and forestry community.
https://github.com/blutjens/awesome-forests
List: awesome-forests
biodiversity carbon climate-change datasets deep-learning ecosystems forestry machine-learning
Last synced: 22 days ago
JSON representation
🌳 A curated list of ground-truth forest datasets for the machine learning and forestry community.
- Host: GitHub
- URL: https://github.com/blutjens/awesome-forests
- Owner: blutjens
- License: cc0-1.0
- Created: 2021-07-13T20:24:40.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2023-03-09T16:02:47.000Z (over 1 year ago)
- Last Synced: 2024-06-11T17:29:18.855Z (5 months ago)
- Topics: biodiversity, carbon, climate-change, datasets, deep-learning, ecosystems, forestry, machine-learning
- Homepage:
- Size: 746 KB
- Stars: 253
- Watchers: 8
- Forks: 34
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- Contributing: contributing.md
- License: license
- Code of conduct: code-of-conducts.md
Awesome Lists containing this project
- awesome-earth-system-ml - **Awesome Forests**
- ultimate-awesome - awesome-forests - 🌳 A curated list of ground-truth forest datasets for the machine learning and forestry community. (Other Lists / PowerShell Lists)
README
# awesome-forests [![Awesome](https://awesome.re/badge-flat2.svg)](https://awesome.re)
**Awesome-forests** is a curated list of ground-truth/validation/in situ forest datasets for the forest-interested machine learning community. The list targets data-based biodiversity, carbon, wildfire, ecosystem service, you name it! analysis.Getting started with data science in forests is TOUGH. The lack of organized datasets is one reason why. So, this list of datasets intends to get you started with building machine learning models for analysing your forests.
This is a wide open and inclusive community. We would very much appreciate if you add your favorite datasets via a pull request or (emailing (lutjens at mit [dot] edu).
Photo of a dog in a forest, by [**Jamie Street**](https://unsplash.com/@jamie452) on [Unsplash](https://unsplash.com/?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText)## Content
- [**Tree species classification**](#tree-species-classification)
- [**Tree detection**](#tree-detection)
- [**Tree damage / health classification**](#tree-damage-/-health-classification)
- [**Biodiversity flora**](#biodiversity-flora)
- [**Tree crown segmentation**](#tree-crown-segmentation)
- [**Aboveground carbon quantification**](#aboveground-carbon-quantification)
- [**Belowground carbon quantification**](#belowground-carbon-quantification)
- [**Forest type classification**](#forest-type-and-land-cover-classification)
- [**Change detection**](#change-detection-and-deforestation)
- [**Wildfire**](#wildfire)
- [**Wildlife**](#wildlife)
- [**Bioacoustics**](#Bioacoustics)
- [**Raw geospatial imagery**](#raw-geospatial-imagery)
- [**Awesome-awesome**](#awesome-awesome)## Tree species classification
#### Processed
- [**The Auto Arborist Dataset: A Large-Scale Benchmark for Multiview Urban Forest Monitoring Under Domain Shift**](https://google.github.io/auto-arborist/) *(Beery et al., 2022)* \
A tree genus classification dataset from 23 cities in US, Canada with Google Street View imagery with 2M trees and >300 classes.- [**TreeSatAI: Benchmark Archive for Deep Learning in Forest Applications**](https://doi.org/10.5281/zenodo.6598391) *(Schulz et al., 2022)* \
A tree species classification dataset from Lower Saxony, Germany with 50k images of aerial, Sen-1, Sen-2, georeferenced, time-referenced, with species, age, genus, forest type, and land cover.- [**IDtrees NIST NEON**](https://idtrees.org/competition/) *(Weecology, University of Florida, NEON, 2020)* \
A tree species classification dataset from ≈3 National Forest sites, USA, with ≈400 labeled trees of ≈20 species with airborne RGB, Hyperspectral and Lidar imagery.- [**Kaggle Forest Cover Type**](https://www.kaggle.com/c/forest-cover-type-kernels-only/data) *(USFS, 2013?)* \
A tree species classification dataset from Roosevelt National Forest, USA, with ≈15k labeled and ≈565k unlabeled trees with cartographic variables.- [**Pasadena Urban Trees**](http://www.vision.caltech.edu/registree/publications-and-dataset.html) *(Caltech, 2016)* \
A tree species classification dataset from urban Pasadena, USA, with ≈ 80k labeled trees of 18 species with airborne and ground RGB imagery.- [**Open AI Challenge: Aerial Imagery of South Pacific Islands**](https://docs.google.com/document/d/16kKik2clGutKejU8uqZevNY6JALf4aVk2ELxLeR-msQ/edit) *(WeRobotics, Worldbank, 2018)* \
A tree species classification dataset from Kingdom of Tonga with 50km² data of 4 species with airborne RGB imagery.#### Raw
- [**Raw urban street tree inventory data**](https://enterprisecontentnew-usfs.hub.arcgis.com/datasets/raw-urban-street-tree-inventory-data-for-49-california-cities) *(USFS, 2006-2013)* \
A raw dataset from 49 cities in California, USA, with ≈930k trees with forest structure variables (e.g., tree species, height, DBH, crown).- [**New York City Street Tree Map**](https://tree-map.nycgovparks.org/) *(NYC Parks, ?-2021)* \
A raw dataset from urban New York City, USA, with >680k trees of >230 species.- [**Raw data for urban trees in California communities**](https://enterprisecontentnew-usfs.hub.arcgis.com/datasets/7421b43097d04e82ba05835bda8600ec) *(USFS, 2007-2012)* \
A raw dataset from urban California, USA, with ≈4k trees with forest structure variables (e.g., tree species, height, DBH, crown).- [**NEON Woody Plant Vegetation Structure**](https://data.neonscience.org/browse-data) *(NEON)* \
A raw dataset from 49 US national forests with forest structure variables (e.g., tree species, height, DBH, low-res. GPS)## Tree detection
#### Processed
- [**DeepForest WeEcology NEON**](https://github.com/weecology/NeonTreeEvaluation) *(Weecology, NEON, UofFlorida, 2018)* \
A tree detection dataset from ≈22 National Forest sites, USA with >15k labeled and >400k unlabeled trees with airborne RGB, Hyperspectral, and Lidar imagery.- [**Kaggle Aerial Cactus Identification**](https://www.kaggle.com/c/aerial-cactus-identification) *(CONACYT, 2019)* \
A cactus detection dataset from Mexiko with 17k cacti with airborne RGB imagery.- [**Swedish National Forest Data Lab: Forest Damages – Larch Casebearer 1.0.**](http://lila.science/datasets/forest-damages-larch-casebearer/) *(Swedish Forest Agency 2021)* \
A tree detection and classification dataset from 10 sites with RGB drone imagery. In total ~ 102k annotated bounding boxes labeled "Lark" or "other", of which ~ 44,5k are also labeled describing tree
damage in four categories.- [**Norlab – PercepTree**](https://github.com/norlab-ulaval/PercepTreeV1) *(Northern laboratory, 2022)* \
This repository contains two datasets: 43k synthetic forest images and 100 real image dataset. Both include high-definition RGB images with depth information, bounding box, instance segmentation masks and keypoints annotation.#### Raw
* see [Tree species](#tree-species-classification)## Tree damage / health classification
- [**Forest Damages – Larch Casebearer**](https://lila.science/datasets/forest-damages-larch-casebearer/) *(Swedish Forest Agency, 2021)* \
A tree damage classification dataset from 5 areas in Sweden with 1.5k images with >100k labeled trees with airborne RGB## Biodiversity flora
- [**Kaggle iNaturalist**](https://www.kaggle.com/c/inaturalist-2021) *(iNaturalist, FGVC8, 2021)* \
A flora and fauna species classification dataset from global sites with 2.7M labeled images of 10k species with smartphone imagery.- [**Kaggle GeoLifeCLEF 2021**](https://www.imageclef.org/GeoLifeCLEF2021) *(ImageCLEF, 2021)* \
A flora and fauna location-based species recommendation dataset from France with 1.9M labeled images of 31k species with satellite imagery and cartographic variables.## Aboveground carbon quantification
#### Processed
- [**ReforesTree: A Dataset for Estimating Tropical Forest Carbon Stock with Deep Learning and Aerial Imagery**](https://github.com/gyrrei/ReforesTree) *(Reiersen et al., 2022)* \
An ML-processed dataset from six reforestation sites in Ecuador for estimating aboveground biomass with RGB drone imagery and individual tree location, bounding box, DBH, species, and biomass. Heavily biased towards banana.
- [**Forest Canopy Height in Mexican Ecosystems**](https://lila.science/datasets/forest-canopy-height-in-mexican-ecosystems) *(Requena-Mullor JM and Caughlin TT, 2018)* \
A forest height quantification dataset from Mexico with lidar-derived canopy height values, Landsat-derived vegetation indices, and 1105 aerial images.#### Raw
- [**Tallo: a global tree allometry and crown architecture database**](https://doi.org/10.1111/gcb.16302) *(Jucket et al., 2022)* \
A dataset with 500k georeferenced records of individual trees >62k globally distributed sites, >5k tree species from >180 plant families with >100 data contributors from >40 countries- [**NASA G-LiHT: Goddard's LiDAR, Hyperspectral & Thermal Imager**](https://gliht.gsfc.nasa.gov/about/) *(Cook et al., 2013)*
A raw dataset from US forests with high-resolution (<1m) LiDAR, hyperspectral, and thermal imagery- [**BAAD: a Biomass And Allometry Database for woody plants**](https://doi.org/10.1890/14-1889.1) *(Falster et al., 2015)* \
A raw aboveground biomass dataset from global sites with 260k measurements collected in 176 different studies, from 21k individual trees across ~700 species.- [**FOS: The Forest Observation System, building a global reference dataset for remote sensing of forest biomass**](http://forest-observation-system.net/) *(Schepaschenko et al., 2019)*
A raw aboveground biomass dataset from global sites with 1.6k sub-plots (0.25ha) containing geolocation (+-1km), canopy height, aboveground biomass estimates and more.- [**TRY: a Global Database of Plant Traits**](https://doi.org/10.1111/j.1365-2486.2011.02451.x) *(Kattge et al., 2011)* \
A raw plant trait dataset from global sites with 3.0M individual entries across 69k out of 300k existing plant species. The data focuses on 52 trait groups that characterize the vegetative and regeneration stages of the plant life cycle, including growth, dispersal, establishment and persistence- [**GWDD: Global Wood Density Dataset**](https://doi.org/10.5061/dryad.234) *(Zanne et al., 2009)* \
A raw wood density dataset containing the wood density of 8.4k species.- [**GlobAllomeTree: Assessing volume, biomass and carbon stocks of trees and forests**](http://www.globallometree.org/) *(FAO et al., 2013)* \
A large raw dataset of allometric equations, wood densities, raw biomass and volume data, and biomass extension factors.- see Table S4 in [**The global forest above-ground biomass pool for 2010 estimated from high-resolution satellite observations**](https://doi.org/10.5194/essd-13-3927-2021) *(Santoro et al., 2021)* for more.
## Belowground carbon quantification
* todo: add ground-truth datasets on belowground carbon inventories## Tree crown segmentation
#### Processed
* todo. To get started, see [Tree Detection](#tree-detection) for rectangular bounding boxes of tree crowns.#### Raw
* [**An Unexpectedly Large Count of Trees in the West African Sahara and Sahel**](https://daac.ornl.gov/cgi-bin/dsviewer.pl?ds_id=1832) (Brandt et al., 2020) \
A raw dataset of the West Sahara with ≈3k geolocated tree crown segmentations.* [**Individual tree point clouds and tree measurements from multi-platform laser scanning in German forests**](https://doi.org/10.5194/essd-14-2989-2022) *(Weiser et al., 2022)* \
Spatially overlapping 3D laser scanning point clouds acquired from three different acquisition platforms (airplane, UAV and terrestrial tripod) in 12 forest plots in Germany, including individually segmented single tree point clouds and field-measured as well as point-cloud derived tree metrics. Also available for download from the [pytreedb demo website](https://pytreedb.geog.uni-heidelberg.de/), including various filtering options.## Forest type / land cover classification
- [**BigEarthNet: large-scale Sentinel-2 benchmark**](http://bigearth.net/) *(TU Berlin, 2019)* \
A landcover multi-classification dataset from 10 European countries with ≈600k labeled images with CORINE land cover labels with Sentinel-2 L2A (10m res.) satellite imagery.- [**Chesapeake land cover**](http://lila.science/datasets/chesapeakelandcover) *(Chesapeake Conservancy, Microsoft, NAIP, USGS, 2013-2017)* \
A land cover classification dataset from the Chesapeake Bay, USA, of a 6x7km² area with high- and low-resolution (NLCD) land cover labels with high- (NAIP, RGB-NIR) and low-resolution (Landsat 8, 13-band) satellite imagery.- [**Kaggle Planet: Understanding the Amazon from Space**](https://www.kaggle.com/c/planet-understanding-the-amazon-from-space) *(SCCON, Planet, 2017)* \
A land cover classification dataset from the Amazon with deforestation, mining, cloud labels with RGB-NIR (5m res.) satellite imagery.- [**WiDS Datathon 2019: detection of oil palm plantations**](https://www.kaggle.com/c/widsdatathon2019) *(Global WiDS Team & West Big Data Innovation Hub, 2019)* \
Binary palm oil plantation classification with 20k images with Planet RGB (3m res.) satellite imagery- [**UC Merced land use dataset**](https://www.tensorflow.org/datasets/catalog/uc_merced)*(UC Merced, 2010)* \
A small land cover classification dataset with 2100 images and 21 balanced classes with airborne (0.3m res.) imagery.- See [**Awesome satellite imagery datasets**](https://github.com/chrieke/awesome-satellite-imagery-datasets) for more satellite imagery datasets.
- See [**SustainBench**](https://github.com/chrieke/awesome-satellite-imagery-datasets) for more UN SDG -related satellite imagery datasets.
## Change detection (i.e., deforestation)
- [**Dynamic EarthNet challenge**](http://www.classic.grss-ieee.org/earthvision2021/challenge.html) *(Planet, DLR, TUM, 2021)* \
A time-series prediction and multi-class change detection dataset of Europe over 2-years with 75 image time-series with 7 land-cover labels and weekly Planet RGB (3m res.) imagery.- [**Semantic change detection dataset (SECOND)**](http://www.captain-whu.com/PROJECT/SCD/) *(Yang et al., 2020)* \
A land cover change detection dataset in over cities and suburbs in China with ≈5k image-pairs with 6 land cover classes and airborne imagery.- [**ForestNet deforestation driver**](https://stanfordmlgroup.github.io/projects/forestnet/) *(Jeremy Irvin, Hao Sheng et al., 2020)* \
A dataset that consists of 2,756 LANDSAT-8 satellite images of forest loss events with deforestation driver annotations. The driver annotations were grouped into Plantation, Smallholder Agriculture, Grassland/shrubland, and Other.- [**Global Forest Change**](https://glad.earthengine.app/view/global-forest-change) *(University of Maryland, 2013)* \
Different layers of global forest loss, extracted from Landsat satellite imagery, todo: this is a data product, find ground-truth data- [**Awesome remote sensing change detection**](https://github.com/wenhwu/awesome-remote-sensing-change-detection) \
A list with more change detection datasets.## Wildfire
* todo: add datasets for fire detection, fuel moisture quantification, wildfire spread prediction, etc.
- todo: Add https://mlhub.earth/data/su_sar_moisture_content_main, https://www.sciencedirect.com/science/article/pii/S003442572030167X?via%3Dihub## Wildlife
- [**iWildCam**](https://github.com/visipedia/iwildcam_comp) A species classification dataset from 414 global locations with >200k labeled images with wildlife camera trap imagery, Landsat-8 multispectral imagery, and GPS coordinates.
- [**iNaturalist**](https://github.com/visipedia/inat_comp) Multiple species classification datasets from global imagery of animals and plants with >2.7M from 10k species.
- See [*LILA.science*](https://lila.science/datasets) for more processed conservation datasets
- See [*Awesome-deep-ecology*](https://github.com/patrickcgray/awesome-deep-ecology/) for more ecology datasets
## Bioacoustics
- todo: add bioacoustics datasets
## Raw geospatial imagery
- [**Global ecosystem dynamics investigation (GEDI)**](https://gedi.umd.edu/data/download/) *(NASA, University of Maryland, 2021)* \
A satellite lidar dataset of the globe with topography and lidar pointcloud (100m res.).- [**Norway's international climate and forests initiative imagery program (NICFI)**](https://www.planet.com/nicfi/) *(NICFI, Ksat, Airbus, Planet, 2020)* \
A satellite imagery dataset of tropical rainforests with monthly mosaics of RGB (5m res.) satellite imagery.- [**National agriculture imagery program (NAIP)**](https://developers.google.com/earth-engine/datasets/catalog/USDA_NAIP_DOQQ) *(FSA USDA, 2003-2021)* \
An airborne imagery dataset of CONUS with RGB-NIR (0.5m res.) imagery.- see [**awesome-gis**](https://github.com/sshuair/awesome-gis#data)
## Awesome-awesome
- [**Awesome satellite imagery datasets**](https://github.com/chrieke/awesome-satellite-imagery-datasets) \
A list of more satellite imagery datasets with annotations for deep learning and computer vision.- [**Awesome GIS**](https://github.com/sshuair/awesome-gis) \
A list of GIS resources.- todo: add link to dataset list on [conservationtech.directory](https://conservationtech.directory/)
## Attributions
- Awesome-forests contains individual entries from [Awesome satellite imagery datasets](https://github.com/chrieke/awesome-satellite-imagery-datasets) and [Awesome remote sensing change detection](https://github.com/wenhwu/awesome-remote-sensing-change-detection)