Open Access Repository

Cloud-assisted multi-view video summarization using CNN and bi-directional LSTM

Downloads

Downloads per month over past year

Hussain, T, Muhammad, K, Ullah, A, Cao, Z ORCID: 0000-0003-3656-0328, Baik, SW and de Albuquerque, VHC 2019 , 'Cloud-assisted multi-view video summarization using CNN and bi-directional LSTM' , IEEE Transactions on Industrial Informatics , pp. 1-10 , doi: 10.1109/TII.2019.2929228.

[img]
Preview
PDF
133983 - Cloud-...pdf | Download (1MB)

| Preview

Abstract

The massive amount of video data produced by surveillance networks in industries instigate various challenges in exploring these videos for many applications such as video summarization, analysis, indexing, and retrieval. The task of multi-view video summarization (MVS) is very challenging due to the gigantic size of data, redundancy, overlapping in views, light variations, and inter-view correlations. To address these challenges, various low-level features and clustering based soft computing techniques are proposed that cannot fully exploit MVS. In this article, we achieve MVS by integrating deep neural network based soft computing techniques in a two tier framework. The first online tier performs target appearance based shots segmentation and stores them in a lookup table that is transmitted to cloud for further processing. The second tier extracts deep features from each frame of a sequence in the lookup table and pass them to deep bi-directional long short-term memory (DB-LSTM) to acquire probabilities of informativeness to generate summary. Experimental evaluation on MVS benchmark dataset and industrial surveillance data from YouTube confirms the higher accuracy of our system compared to state-of-the-art MVS methods.

Item Type: Article
Authors/Creators:Hussain, T and Muhammad, K and Ullah, A and Cao, Z and Baik, SW and de Albuquerque, VHC
Keywords: artificial intelligence, cloud computing, convolutional neural networks, industrial surveillance, multi-view videos, soft computing, video summarization, LSTM
Journal or Publication Title: IEEE Transactions on Industrial Informatics
Publisher: Institute of Electrical and Electronics Engineers
ISSN: 1551-3203
DOI / ID Number: 10.1109/TII.2019.2929228
Copyright Information:

Copyright 2019 IEEE.

Related URLs:
Item Statistics: View statistics for this item

Actions (login required)

Item Control Page Item Control Page
TOP