Click on “Download PDF” for the PDF version or on the title for the HTML version.

If you are not an ASABE member or if your employer has not arranged for access to the full-text, Click here for options.

Graph Neural Networks for Plant Organ Tracking

Published by the American Society of Agricultural and Biological Engineers, St. Joseph, Michigan

Citation:  2021 ASABE Annual International Virtual Meeting  2100843.(doi:10.13031/aim.202100843)
Authors:   Daniel J Petti, Changying Li
Keywords:   High-Throughput Phenotyping, Machine Vision, Graph Neural Network, Convolutional Neural Network, Multi-Object Tracking

Abstract. Much progress has been made over the past decade on the problem of multi-object tracking. Many recent techniques leverage Convolutional Neural Networks (CNNs) and are focused on the domain of autonomous driving or people-tracking. In contrast, we concern ourselves with how these recent advances can be adapted to the domain of High-Throughput Phenotyping (HTP). HTP leverages automated sensing capabilities in order to speed up the process of measuring plant phenotypic traits to advance breeding programs. Many specific problems within the domain of HTP require the accurate localization of plant organs, as well as the tracking of the organs over time. Mobile robotic platforms (both ground and air) are typically equipped with localization sensors as well as RGB cameras. We propose a Graph Convolutional Neural Network (GCNN) that is capable of extracting and fusing features from RGB cameras over multiple frames, as well as using these features in a Graph Neural Network to solve the tracking association problem. Our end-to-end tracking approach requires minimal hyperparameters and is easier to train than older approaches that separate affinity computation and track association into two steps. Specifically, we demonstrate our system‘s ability to detect and track individual cotton blossoms in the field, which will be important for both breeding programs and yield estimation.

(Download PDF)    (Export to EndNotes)