Show simple item record

dc.contributor.authorPicon, Artzai
dc.contributor.authorMedela, Alfonso
dc.contributor.authorSanchez-Peralta, Luisa F.
dc.contributor.authorCicchi, Riccardo
dc.contributor.authorBilbao, Roberto
dc.contributor.authorAlfieri, Domenico
dc.contributor.authorElola, Andoni
dc.contributor.authorGlover, Ben
dc.contributor.authorSaratxaga, Cristina L.
dc.date.accessioned2021-03-01T14:51:02Z
dc.date.available2021-03-01T14:51:02Z
dc.date.issued2021-02
dc.identifier.citationPicon, Artzai, Alfonso Medela, Luisa F. Sanchez-Peralta, Riccardo Cicchi, Roberto Bilbao, Domenico Alfieri, Andoni Elola, Ben Glover, and Cristina L. Saratxaga. “Autofluorescence Image Reconstruction and Virtual Staining for in-Vivo Optical Biopsying.” IEEE Access (2021): 1–1. doi:10.1109/access.2021.3060926.en
dc.identifier.urihttp://hdl.handle.net/11556/1087
dc.description.abstractModern photonic technologies are emerging, allowing the acquisition of in-vivo endoscopic tissue imaging at a microscopic scale, with characteristics comparable to traditional histological slides, and with a label-free modality. This raises the possibility of an ‘optical biopsy’ to aid clinical decision making. This approach faces barriers for being incorporated into clinical practice, including the lack of existing images for training, unfamiliarity of clinicians with the novel image domains and the uncertainty of trusting ‘black-box’ machine learned image analysis, where the decision making remains inscrutable. In this paper, we propose a new method to transform images from novel photonics techniques (e.g. autofluorescence microscopy) into already established domains such as Hematoxilyn-Eosin (H-E) microscopy through virtual reconstruction and staining. We introduce three main innovations: 1) we propose a transformation method based on a Siamese structure that simultaneously learns the direct and inverse transformation ensuring domain back-transformation quality of the transformed data. 2) We also introduced an embedding loss term that ensures similarity not only at pixel level, but also at the image embedding description level. This drastically reduces the perception distortion trade-off problem existing in common domain transfer based on generative adversarial networks. These virtually stained images can serve as reference standard images for comparison with the already known H-E images. 3) We also incorporate an uncertainty margin concept that allows the network to measure its own confidence, and demonstrate that these reconstructed and virtually stained images can be used on previously-studied classification models of H-E images that have been computationally degraded and de-stained. The three proposed methods can be seamlessly incorporated on any existing architectures. We obtained balanced accuracies of 0.95 and negative predictive values of 1.00 over the reconstructed and virtually stained image-set on the detection of color-rectal tumoral tissue. This is of great importance as we reduce the need for extensive labeled datasets for training, which are normally not available on the early studies of a new imaging technology.en
dc.description.sponsorshipThe authors would like to thank all pathologists that generated the BIOPOOL dataset (FP7-ICT-296162) that has been used for this work and specially to M. Saiz, A. Gaafar, S. Fernandez, A. Saiz, E. de Miguel, B. Catón, J. J. Aguirre, R. Ruiz, Ma A. Viguri, and R. Rezola.en
dc.language.isoengen
dc.publisherIEEEen
dc.rightsAttribution 4.0 International*
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/*
dc.titleAutofluorescence image reconstruction and virtual staining for in-vivo optical biopsyingen
dc.typearticleen
dc.identifier.doi10.1109/access.2021.3060926en
dc.relation.projectIDinfo:eu-repo/grantAgreement/EC/FP7/296162/EU/SERVICES ASSOCIATED TO DIGITALISED CONTENTS OF TISSUES IN BIOBANKS ACROSS EUROPE/BIOPOOLen
dc.rights.accessRightsopenAccessen
dc.subject.keywordsHistopathology analysisen
dc.subject.keywordsConvolutional neural networken
dc.subject.keywordsDomain adaptationen
dc.subject.keywordsOptical biopsyen
dc.subject.keywordsVirtual stainingen
dc.subject.keywordsSiamese semantic regression networksen
dc.identifier.essn2169-3536en
dc.journal.titleIEEE Accessen
dc.page.final32093en
dc.page.initial32081en
dc.volume.number9en


Files in this item

Thumbnail

    Show simple item record

    Attribution 4.0 InternationalExcept where otherwise noted, this item's license is described as Attribution 4.0 International