Show simple item record

dc.contributor.authorBarredo Arrieta, Alejandro
dc.contributor.authorGil-Lopez, Sergio
dc.contributor.authorLaña, Ibai
dc.contributor.authorBilbao, Miren Nekane
dc.contributor.authorDel Ser, Javier
dc.date.accessioned2022-01-17T08:51:42Z
dc.date.available2022-01-17T08:51:42Z
dc.date.issued2021-08-06
dc.identifier.citationBarredo Arrieta, Alejandro, Sergio Gil-Lopez, Ibai Laña, Miren Nekane Bilbao, and Javier Del Ser. “On the Post-Hoc Explainability of Deep Echo State Networks for Time Series Forecasting, Image and Video Classification.” Neural Computing and Applications (August 6, 2021). doi:10.1007/s00521-021-06359-y.en
dc.identifier.issn0941-0643en
dc.identifier.urihttp://hdl.handle.net/11556/1250
dc.description.abstractSince their inception, learning techniques under the reservoir computing paradigm have shown a great modeling capability for recurrent systems without the computing overheads required for other approaches, specially deep neural networks. Among them, different flavors of echo state networks have attracted many stares through time, mainly due to the simplicity and computational efficiency of their learning algorithm. However, these advantages do not compensate for the fact that echo state networks remain as black-box models whose decisions cannot be easily explained to the general audience. This issue is even more involved for multi-layered (also referred to as deep) echo state networks, whose more complex hierarchical structure hinders even further the explainability of their internals to users without expertise in machine learning or even computer science. This lack of explainability can jeopardize the widespread adoption of these models in certain domains where accountability and understandability of machine learning models is a must (e.g., medical diagnosis, social politics). This work addresses this issue by conducting an explainability study of echo state networks when applied to learning tasks with time series, image and video data. Among these tasks, we stress on the latter one (video classification) which, to the best of our knowledge, has never been tackled before with echo state networks in the related literature. Specifically, the study proposes three different techniques capable of eliciting understandable information about the knowledge grasped by these recurrent models, namely potential memory, temporal patterns and pixel absence effect. Potential memory addresses questions related to the effect of the reservoir size in the capability of the model to store temporal information, whereas temporal patterns unveil the recurrent relationships captured by the model over time. Finally, pixel absence effect attempts at evaluating the effect of the absence of a given pixel when the echo state network model is used for image and video classification. The benefits of the proposed suite of techniques are showcased over three different domains of applicability: time series modeling, image and, for the first time in the related literature, video classification. The obtained results reveal that the proposed techniques not only allow for an informed understanding of the way these models work, but also serve as diagnostic tools capable of detecting issues inherited from data (e.g., presence of hidden bias).en
dc.description.sponsorshipThis work has received funding support from the Basque Government (Eusko Jaurlaritza) through the Consolidated Research Group MATHMODE (IT1294-19) and ELKARTEK program (3KIA project, KK-2020/00049).en
dc.language.isoengen
dc.publisherSpringeren
dc.titleOn the post-hoc explainability of deep echo state networks for time series forecasting, image and video classificationen
dc.typearticleen
dc.identifier.doi10.1007/s00521-021-06359-yen
dc.rights.accessRightsembargoedAccessen
dc.subject.keywordsExplainable artificial intelligenceen
dc.subject.keywordsRandomization-based machine learningen
dc.subject.keywordsReservoir computingen
dc.subject.keywordsEcho state networksen
dc.identifier.essn1433-3058en
dc.journal.titleNeural Computing and Applicationsen


Files in this item

FilesSizeFormatView

There are no files associated with this item.

    Show simple item record