Activity Recognition Using Temporal Optical Flow Convolutional Features and Multilayer LSTM
No Thumbnail Available
Identifiers
Publication date
2019-12
Advisors
Journal Title
Journal ISSN
Volume Title
Publisher
Citations
Export
Abstract
Nowadays digital surveillance systems are universally installed for continuously collecting enormous amounts of data, thereby requiring human monitoring for the identification of different activities and events. Smarter surveillance is the need of this era through which normal and abnormal activities can be automatically identified using artificial intelligence and computer vision technology. In this paper, we propose a framework for activity recognition in surveillance videos captured over industrial systems. The continuous surveillance video stream is first divided into important shots, where shots are selected using the proposed convolutional neural network (CNN) based human saliency features. Next, temporal features of an activity in the sequence of frames are extracted by utilizing the convolutional layers of a FlowNet2 CNN model. Finally, a multilayer long short-term memory is presented for learning long-term sequences in the temporal optical flow features for activity recognition. Experiments11https://github.com/Aminullah6264/Activity-Rec-ML-LSTM. are conducted using different benchmark action and activity recognition datasets, and the results reveal the effectiveness of the proposed method for activity recognition in industrial settings compared with state-of-the-art methods.
Description
Publisher Copyright: © 1982-2012 IEEE.
Type
Citation
Ullah , A , Muhammad , K , Del Ser , J , Baik , S W & De Albuquerque , V H C 2019 , ' Activity Recognition Using Temporal Optical Flow Convolutional Features and Multilayer LSTM ' , IEEE Transactions on Industrial Electronics , vol. 66 , no. 12 , 8543495 , pp. 9692-9702 . https://doi.org/10.1109/TIE.2018.2881943