Panel Discussion: Emerging Topics on Video Summarization
Mohan Kankanhalli
National University of Singapore
mohan@comp.nus.edu.sg
Yongkang Wong
National University of Singapore
yongkang.wong@nus.edu.sg
ABSTRACT
With video capture devices becoming widely popular, the amount
of video data generated per day has seen a rapid increase over the
past few years. Browsing through hours of video data to retrieve
useful information is a tedious and boring task. Video Summa-
rization technology has played a crucial role in addressing this
issue and is a well-researched topic in the multimedia community.
This panel aims to bring together researchers working on relevant
backgrounds to discuss emerging topics on video summarization,
including recent developments, future directions, challenges, solu-
tions, potential applications and other open problems.
CCS CONCEPTS
• Computing methodologies → Artificial intelligence; Ma-
chine learning.
KEYWORDS
Computer vision, video summarization
ACM Reference Format:
Mohan Kankanhalli, Jianquan Liu, Yongkang Wong, and Karen Stephen.
2022. Panel Discussion: Emerging Topics on Video Summarization. In Pro-
ceedings of the 1st Workshop on User-centric Narrative Summarization of Long
Videos (NarSUM ’22), October 10, 2022, Lisboa, Portugal. ACM, New York,
NY, USA, 1 page. https://doi.org/10.1145/3552463.3558051
1 INTRODUCTION
Video summarization has been an active research topic and an im-
portant multimedia application for a very long time. This panel
aims to bring together researchers in academia and industry to
discuss topics related to video summarization of long videos, its
applications and other open problems relevant in this field. Most
of the research so far has been primarily focused on creating sum-
mary to short videos (spanning only a few minutes) [3–7, 9]. The
datasets commonly used are the SumMe [2], TVSum [8], OVP [1],
and Youtube [1] datasets, where the video duration are often short.
This panel discussion will discuss various emerging topics on video
summarization and discuss other aspects of summarization research
including what makes a good video summary, how to create datasets
Permission to make digital or hard copies of part or all of this work for personal or
classroom use is granted without fee provided that copies are not made or distributed
for profit or commercial advantage and that copies bear this notice and the full citation
on the first page. Copyrights for third-party components of this work must be honored.
For all other uses, contact the owner/author(s).
NarSUM ’22, October 10, 2022, Lisboa, Portugal
© 2022 Copyright held by the owner/author(s).
ACM ISBN 978-1-4503-9493-2/22/10.
https://doi.org/10.1145/3552463.3558051
Jianquan Liu
NEC Corporation
jqliu@nec.com
Karen Stephen
NEC Corporation
stephenkaren@nec.com
for long video summarization, how to capture and represent the
semantics of a long video, how to create a narrative summary of a
long video, what is a good story, applications of long video summa-
rization, and other open challenges in video summarization.
2 THE PANEL
This panel will include reputable researchers in academia and in-
dustry to discuss and debate on topics related to summarization
of long videos, recent developments, future directions, challenges,
solutions, potential applications and other open problems relevant
in this field. Specifically, the topics of interests for the panel include,
but are not limited to
• Summarization of single/multiple long videos
• Action and scene graph generation from videos
• Narrative summary and video storytelling
• Datasets for long video summarization
• Novel evaluation criteria/metrics
• Novel application of long video summarization
• Open challenges in video summarization
• Privacy preserved video summarization
REFERENCES
[1] Sandra Eliza Fontes De Avila, Ana Paula Brandao Lopes, Antonio da Luz Jr, and
Arnaldo de Albuquerque Araújo. 2011. VSUMM: A mechanism designed to produce
static video summaries and a novel evaluation method. Pattern recognition letters
32, 1 (2011), 56–68.
[2] Michael Gygli, Helmut Grabner, Hayko Riemenschneider, and Luc Van Gool. 2014.
Creating summaries from user videos. In European conference on computer vision.
Springer, 505–520.
[3] Xufeng He, Yang Hua, Tao Song, Zongpu Zhang, Zhengui Xue, Ruhui Ma, Neil
Robertson, and Haibing Guan. 2019. Unsupervised video summarization with
attentive conditional generative adversarial networks. In Proceedings of the 27th
ACM International Conference on multimedia. 2296–2304.
[4] Yunjae Jung, Donghyeon Cho, Dahun Kim, Sanghyun Woo, and In So Kweon.
2019. Discriminative feature learning for unsupervised video summarization. In
Proceedings of the AAAI Conference on artificial intelligence, Vol. 33. 8537–8544.
[5] Behrooz Mahasseni, Michael Lam, and Sinisa Todorovic. 2017. Unsupervised
video summarization with adversarial lstm networks. In Proceedings of the IEEE
conference on Computer Vision and Pattern Recognition. 202–211.
[6] Mrigank Rochan and Yang Wang. 2019. Video summarization by learning from
unpaired data. In Proceedings of the IEEE/CVF Conference on Computer Vision and
Pattern Recognition. 7902–7911.
[7] Mrigank Rochan, Linwei Ye, and Yang Wang. 2018. Video summarization using
fully convolutional sequence networks. In Proceedings of the European conference
on computer vision (ECCV). 347–363.
[8] Yale Song, Jordi Vallmitjana, Amanda Stent, and Alejandro Jaimes. 2015. Tvsum:
Summarizing web videos using titles. In Proceedings of the IEEE conference on
computer vision and pattern recognition. 5179–5187.
[9] Li Yuan, Francis EH Tay, Ping Li, Li Zhou, and Jiashi Feng. 2019. Cycle-SUM: Cycle-
consistent adversarial LSTM networks for unsupervised video summarization. In
Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 9143–9150.