On the post-hoc explainability of deep echo state networks for time series forecasting, image and video classification

Simple item page
dc.contributor.authorBarredo Arrieta, Alejandro
dc.contributor.authorGil-Lopez, Sergio
dc.contributor.authorLaña, Ibai
dc.contributor.authorBilbao, Miren Nekane
dc.contributor.authorDel Ser, Javier
dc.contributor.institutionTecnalia Research & Innovation
dc.contributor.institutionIA
dc.date.issued2022-07
dc.descriptionPublisher Copyright: © 2021, The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature.
dc.description.abstractSince their inception, learning techniques under the reservoir computing paradigm have shown a great modeling capability for recurrent systems without the computing overheads required for other approaches, specially deep neural networks. Among them, different flavors of echo state networks have attracted many stares through time, mainly due to the simplicity and computational efficiency of their learning algorithm. However, these advantages do not compensate for the fact that echo state networks remain as black-box models whose decisions cannot be easily explained to the general audience. This issue is even more involved for multi-layered (also referred to as deep) echo state networks, whose more complex hierarchical structure hinders even further the explainability of their internals to users without expertise in machine learning or even computer science. This lack of explainability can jeopardize the widespread adoption of these models in certain domains where accountability and understandability of machine learning models is a must (e.g., medical diagnosis, social politics). This work addresses this issue by conducting an explainability study of echo state networks when applied to learning tasks with time series, image and video data. Among these tasks, we stress on the latter one (video classification) which, to the best of our knowledge, has never been tackled before with echo state networks in the related literature. Specifically, the study proposes three different techniques capable of eliciting understandable information about the knowledge grasped by these recurrent models, namely potential memory, temporal patterns and pixel absence effect. Potential memory addresses questions related to the effect of the reservoir size in the capability of the model to store temporal information, whereas temporal patterns unveil the recurrent relationships captured by the model over time. Finally, pixel absence effect attempts at evaluating the effect of the absence of a given pixel when the echo state network model is used for image and video classification. The benefits of the proposed suite of techniques are showcased over three different domains of applicability: time series modeling, image and, for the first time in the related literature, video classification. The obtained results reveal that the proposed techniques not only allow for an informed understanding of the way these models work, but also serve as diagnostic tools capable of detecting issues inherited from data (e.g., presence of hidden bias).en
dc.description.sponsorshipThis work has received funding support from the Basque Government (Eusko Jaurlaritza) through the Consolidated Research Group MATHMODE (IT1294-19) and ELKARTEK program (3KIA project, KK-2020/00049).
dc.description.statusPeer reviewed
dc.format.extent21
dc.identifier.citationBarredo Arrieta , A , Gil-Lopez , S , Laña , I , Bilbao , M N & Del Ser , J 2022 , ' On the post-hoc explainability of deep echo state networks for time series forecasting, image and video classification ' , Neural Computing and Applications , vol. 34 , no. 13 , pp. 10257-10277 . https://doi.org/10.1007/s00521-021-06359-y
dc.identifier.doi10.1007/s00521-021-06359-y
dc.identifier.issn0941-0643
dc.identifier.otherresearchoutputwizard: 11556/1250
dc.identifier.urlhttp://www.scopus.com/inward/record.url?scp=85111830181&partnerID=8YFLogxK
dc.language.isoeng
dc.relation.ispartofNeural Computing and Applications
dc.relation.projectIDEusko Jaurlaritza, KK-2020/00049-IT1294-19
dc.rightsinfo:eu-repo/semantics/openAccess
dc.subject.keywordsEcho state networks
dc.subject.keywordsExplainable artificial intelligence
dc.subject.keywordsRandomization-based machine learning
dc.subject.keywordsReservoir computing
dc.subject.keywordsExplainable artificial intelligence
dc.subject.keywordsRandomization-based machine learning
dc.subject.keywordsReservoir computing
dc.subject.keywordsEcho state networks
dc.subject.keywordsSoftware
dc.subject.keywordsArtificial Intelligence
dc.subject.keywordsSDG 7 - Affordable and Clean Energy
dc.subject.keywordsFunding Info
dc.subject.keywordsThis work has received funding support from the Basque Government (Eusko Jaurlaritza) through the Consolidated Research Group MATHMODE (IT1294-19) and ELKARTEK program (3KIA project, KK-2020/00049).
dc.subject.keywordsThis work has received funding support from the Basque Government (Eusko Jaurlaritza) through the Consolidated Research Group MATHMODE (IT1294-19) and ELKARTEK program (3KIA project, KK-2020/00049).
dc.titleOn the post-hoc explainability of deep echo state networks for time series forecasting, image and video classificationen
dc.typejournal article
Files