FINAL PRESENTATIONS AI FOR TREES

Presentation
Data Enrichment

Building the global AI for Good community www.fruitpunch.ai

 FINAL PRESENTATIONS AI FOR TREES

Data Enrichment Team

Alexandra Smith Lee Dudek

Melanie Arp Tim Broadhurst

Building the global AI for Good community www.fruitpunch.ai

 FINAL PRESENTATIONS AI FOR TREES

Starting Point

40 drone images available

Partially labeled

Height data available

Building the global AI for Good community www.fruitpunch.ai

 FINAL PRESENTATIONS AI FOR TREES

Goal

More labeled trees

Building the global AI for Good community www.fruitpunch.ai
 FINAL PRESENTATIONS AI FOR TREES

Solution - options
Manual Existing
Labeling datasets

Self-
Data
supervisedla
augmentation
beling

Building the global AI for Good community www.fruitpunch.ai

 FINAL PRESENTATIONS AI FOR TREES

Solution - options
Manual Existing
Labeling datasets

Self-
Data
supervisedla
augmentation
beling

Building the global AI for Good community www.fruitpunch.ai

 FINAL PRESENTATIONS AI FOR TREES

Solution - manual labeling

cfru.it

Building the global AI for Good community www.fruitpunch.ai

 FINAL PRESENTATIONS AI FOR TREES

Solution - quality assurance

Digital Surface Model (DSM)

Height
0m

15.5 m

Building the global AI for Good community www.fruitpunch.ai

 FINAL PRESENTATIONS AI FOR TREES

Solution - quality assurance

Trees that were missed in the annotations

Different trees that were annotated as a single tree

Building the global AI for Good community www.fruitpunch.ai

 FINAL PRESENTATIONS AI FOR TREES

Solution - quality assurance

Annotated trees with very low height and/or no visible shadow

Building the global AI for Good community www.fruitpunch.ai

 FINAL PRESENTATIONS AI FOR TREES

Solution - augmentation

Position augmentation

Color augmentation

Building the global AI for Good community www.fruitpunch.ai

 FINAL PRESENTATIONS AI FOR TREES

Results

16.102 trees labeled

Building the global AI for Good community www.fruitpunch.ai
 FINAL PRESENTATIONS AI FOR TREES

Lessons learned

Labeling trees is resource-intensive

Combination of RGB and DSM input most useful in detecting trees (manually)

Increase amount of high-quality data through augmentation

Building the global AI for Good community www.fruitpunch.ai