Deep convolutional neural network for damaged vegetation segmentation from RGB images based on virtual NIR-channel estimation

Simple item page
dc.contributor.authorPicon, Artzai
dc.contributor.authorBereciartua-Perez, Arantza
dc.contributor.authorEguskiza, Itziar
dc.contributor.authorRomero-Rodriguez, Javier
dc.contributor.authorJimenez-Ruiz, Carlos Javier
dc.contributor.authorEggers, Till
dc.contributor.authorKlukas, Christian
dc.contributor.authorNavarra-Mestre, Ramon
dc.contributor.institutionCOMPUTER_VISION
dc.date.issued2022-01
dc.descriptionPublisher Copyright: © 2022 The Authors
dc.description.abstractPerforming accurate and automated semantic segmentation of vegetation is a first algorithmic step towards more complex models that can extract accurate biological information on crop health, weed presence and phenological state, among others. Traditionally, models based on normalized difference vegetation index (NDVI), near infrared channel (NIR) or RGB have been a good indicator of vegetation presence. However, these methods are not suitable for accurately segmenting vegetation showing damage, which precludes their use for downstream phenotyping algorithms. In this paper, we propose a comprehensive method for robust vegetation segmentation in RGB images that can cope with damaged vegetation. The method consists of a first regression convolutional neural network to estimate a virtual NIR channel from an RGB image. Second, we compute two newly proposed vegetation indices from this estimated virtual NIR: the infrared-dark channel subtraction (IDCS) and infrared-dark channel ratio (IDCR) indices. Finally, both the RGB image and the estimated indices are fed into a semantic segmentation deep convolutional neural network to train a model to segment vegetation regardless of damage or condition. The model was tested on 84 plots containing thirteen vegetation species showing different degrees of damage and acquired over 28 days. The results show that the best segmentation is obtained when the input image is augmented with the proposed virtual NIR channel (F1=0.94) and with the proposed IDCR and IDCS vegetation indices (F1=0.95) derived from the estimated NIR channel, while the use of only the image or RGB indices lead to inferior performance (RGB(F1=0.90) NIR(F1=0.82) or NDVI(F1=0.89) channel). The proposed method provides an end-to-end land cover map segmentation method directly from simple RGB images and has been successfully validated in real field conditions.en
dc.description.statusPeer reviewed
dc.format.extent12
dc.format.extent6615771
dc.identifier.citationPicon , A , Bereciartua-Perez , A , Eguskiza , I , Romero-Rodriguez , J , Jimenez-Ruiz , C J , Eggers , T , Klukas , C & Navarra-Mestre , R 2022 , ' Deep convolutional neural network for damaged vegetation segmentation from RGB images based on virtual NIR-channel estimation ' , Artificial Intelligence in Agriculture , vol. 6 , pp. 199-210 . https://doi.org/10.1016/j.aiia.2022.09.004
dc.identifier.doi10.1016/j.aiia.2022.09.004
dc.identifier.issn2589-7217
dc.identifier.otherresearchoutputwizard: 11556/1418
dc.identifier.urlhttp://www.scopus.com/inward/record.url?scp=85139369521&partnerID=8YFLogxK
dc.language.isoeng
dc.relation.ispartofArtificial Intelligence in Agriculture
dc.rightsinfo:eu-repo/semantics/openAccess
dc.subject.keywordsVegetation indices estimation
dc.subject.keywordsVegetation coverage map
dc.subject.keywordsNear infrared estimation
dc.subject.keywordsConvolutional neural network
dc.subject.keywordsDeep learning
dc.subject.keywordsVegetation indices estimation
dc.subject.keywordsVegetation coverage map
dc.subject.keywordsNear infrared estimation
dc.subject.keywordsConvolutional neural network
dc.subject.keywordsDeep learning
dc.subject.keywordsComputer Science (miscellaneous)
dc.subject.keywordsEngineering (miscellaneous)
dc.subject.keywordsGeneral Agricultural and Biological Sciences
dc.subject.keywordsComputer Science Applications
dc.subject.keywordsArtificial Intelligence
dc.subject.keywordsSDG 2 - Zero Hunger
dc.titleDeep convolutional neural network for damaged vegetation segmentation from RGB images based on virtual NIR-channel estimationen
dc.typejournal article
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
1-s2.0-S2589721722000149-main.pdf
Size:
6.31 MB
Format:
Adobe Portable Document Format
Download