Professional Documents
Culture Documents
JPSP - 2022 - 115
JPSP - 2022 - 115
JPSP - 2022 - 115
com
2022, Vol. 6, No. 8, 1204-1209
*1, 2 Assistant Professor (A), Department of Computer Science and Engineering, Jawaharlal Nehru Technological
University College of Engineering, Pulivendula, Andhra Pradesh, India, E-mail:- vijaya.jntuacep@gmail.com1,
keshava1047@gmail.com2
3, 4, 5
Student (U.G), Department of Computer Science and Engineering, Jawaharlal Nehru Technological University
College of Engineering, Pulivendula, Andhra Pradesh, India, E-mail:-cnarendra329@gmail.com3,
akanksha17p@gmail.com4, sravani0602@gmail.com5
Abstract
The project's goal is to design a user interface that will improve user experience, allow flexibility for downloading
transcript summary files, and automate WhatsApp and email. Throughout the day, an enormous number of video
recordings are generated and shared on the Internet. It has become quite difficult to devote time to watching movies that
may last longer than expected, and our efforts may be in vain if we are unable to extract useful information from them.
Summarizing transcripts of such movies automatically allows us to rapidly spot essential patterns in the video, saving us
time and effort from having to go through the entire content. We use Python APIs for text transcription in this project.
The transcript is then summarized using natural language processing (NLP). User Interface: HTML, CSS, JS, and
Bootstrap For our User Interface, we use Flask for Python as the backend. The user can download the summarized forms,
such as pdf and word, and share his summarized transcript by email and WhatsApp. This project will provide us with
practical experience using NLP approaches for abstractive text summarizing.
Using the Flask framework, this backend takes API There are several videos with transcripts on
calls from the client and answers with a summary YouTube. Summarization is especially effective
text response. This API can only be used with when films are longer and different segments have
YouTube videos that have closed captions that
have been properly prepared. The Summarizer is Varying degrees of importance. In this case, video
also available online, where users may make basic summary may be advantageous in terms of saving
API calls and read the results on a webpage. time for the viewer. It will boost user productivity
by allowing them to concentrate entirely on the
This backend accepts API calls from the client and video's relevant text. It gets its information from
responds with a summary text response using the video subtitles.
Flask framework. This API can only be used with
YouTube videos that have been correctly prepared We'd be developing a capacity for summarizing
closed captions. Users can also utilize the YouTube movies with captions given by the
Summarizer online, where they can execute basic owner, and generating a summarized text answer
API calls and view the results on a webpage. utilizing different summary methods. We will
generate summaries in a variety of forms because
YouTube the Summarizer should be straightforward to use
for the end user.
Is a free online video sharing and social media
platform that launched in the United States in We'll set up a Flask back-end server to receive
February 2005. It is now one of the most popular GET requests with the YouTube Video Id,
video platforms, with subscribers watching over 1 Algorithm Choice, and Response Ratio. This
billion hours of video per day. Closed captions are server will prevent the user from performing any
text retrieved from a video that is intended to give summary processing.
the audience with more information (such as
conversations, speech translation, and non-speech This approach also has the capability of
features). They're widely used to understand video immediately improving the algorithm in the future;
1205 Journal of Positive School Psychology
users do not need to update on their end, saving transcripts from the video link provided by the user
time and money. To obtain the summary, the client and then summarizing the text by using Hugging
may gain access to the API. Face Transformers and Pipelining. The built model
NLP is an area of artificial intelligence that accepts video links and the required summary
explores how humans and machines communicate. duration as input from the user and generates a
Making video transcript summaries is a time- summarized transcript as output.
consuming operation. Longer videos can be
described in a concise, fluent, and, most The proposed method in [3] is focuses on the
importantly, correct manner. recent advances in the area and provides a
comprehensive survey of the existing deep-
The main idea is to be able to choose a small subset learning-based methods for generic video
of the most significant facts from the entire summarization. After presenting the motivation
collection and present it in a simple manner. behind the development of technologies for video
summarization, they formulated the video
A user-friendly layout As the amount of textual summarization task and discuss the main
material on the internet expands, automatic text characteristics of a typical deep-learning-based
summarising techniques are becoming analysis pipeline. Then, suggested a taxonomy of
increasingly common. It has the potential to be the existing algorithms and provide a systematic
tremendously beneficial because more useful review of the relevant literature that shows the
information may be read in less time. Putting evolution of the deep-learning-based video
together summaries. summarization technologies and leads to
suggestions for future developments.
Because machines must understand what humans
have written and produce human-readable results, According to [4], previous methods mainly take
NLP is concerned with transcripts. diversity and representativeness of generated
summaries as prior knowledge in algorithm design.
II. LITERATURE SURVEY In this paper [4], they formulate video
summarization as a content-based recommender
From [1], author proposed two different methods problem, which should distill the most useful
to generate summary and important keywords from content from a long video for users who suffer
the given YouTube video - extractive and from information overload. A scalable deep neural
abstractive. They have made a simple user network is proposed on predicting if one video
interface through which users can easily get their segment is a useful segment for users by explicitly
summaries through these methods, and surely find modelling both segment and video. Moreover, they
it easy to interact with their user interface and get accomplished scene and action recognition in
what they want. Their project surely satisfies the untrimmed videos to find more correlations among
users and solve all the problems that it’s supposed different aspects of video understanding tasks.
to tackle which is saving time and efforts, by Also, paper discussed the effect of audio and visual
providing only the useful information about the features in summarization task.
topic which interests them so that they don't have
to watch those long videos and the time that saved From [5], we can conclude that, video
can be used in gaining more knowledge. summarization and skimming has become an
indispensable tool of any practical video content
In [2], authors propose a video summarizing management system. This paper [5] provides a
system based on natural language processing tutorial on the existing abstraction work for generic
(NLP) and Machine Learning to summarize the videos and presents state-of-the-art techniques for
YouTube video transcripts without losing the key feature film skimming. The paper also describes
elements. The quantity of videos available on web the authors' recent work on movie skimming using
platforms is steadily expanding. The content is audiovisual tempo analysis and specific cinematic
made available globally, primarily for educational rules. With the maturity of the movie genre
purposes. Additionally, educational content is classification, content understanding and video
available on YouTube, Facebook, Google, and abstraction techniques, an automatic movie
Instagram. A significant issue of extracting content analysis system that facilitates navigation,
information from videos is that unlike an image, browsing, and search of desired movie content is
where data can be collected from a single frame, a possible soon.
viewer must watch the entire video to grasp the
context. The suggested method involves retrieving As per [6], Automatic summarization techniques
P. Vijaya Kumari 1206
will give the user an easy way to look up important promising results from the user study on video
content of a collection of media and to browse summarization indicate that the user attention
media of their choice later. With the evolution of model is an alternative way to video
sophisticated capturing devices, cloud-based understanding.
summarization solutions, which have a lot of
turnaround time, are less preferred by end user. In According to [9], argued that video summarization
this paper, author proposed a real-time video would benefit from greater incorporation of
summarization technique for mobile platform external information, particularly user-based
which analyses the video during live camera information that is unobtrusively sourced, in order
recording and generates summary instantaneously. to overcome longstanding challenges such as the
This technique employs the method of analyzing semantic gap and providing video summaries that
intrinsic video data like the contents of video have greater relevance to individual users.
stream, and corresponding extrinsic metadata such
as external camera information of the video stream. In [10], In this paper, authors surveyed the video
The proposed technique has been able to achieve classification literature. They find that features are
an f-measure of 0.66 and 0.84 on SumMe and drawn from three modalities—text, audio, and
SumLive datasets respectively while limiting the visual—and that a large variety of combinations of
overall power consumption to 20 milliamps on an features and classification have been explored.
embedded system. They also described the general features chosen
and summarize the research in this area. We
In [7], Authors propose online video highlighting, conclude with ideas for further research.
a principled way of generating short video
summarizing the most important and interesting III. PROBLEM STATEMENT
contents of an unedited and unstructured video,
costly both timewise and financially for manual Throughout the day, an increasing number of video
processing. Specifically, their method learns a recordings are generated and shared on the
dictionary from given video using group sparse Internet. It has become quite difficult to devote
coding, and updates atoms in the dictionary on-the- time to watching movies that may last longer than
fly. A summary video is then generated by expected, and our efforts may be in vain if we are
combining segments that cannot be sparsely unable to extract useful information from them.
reconstructed using the learned dictionary. The Summarizing transcripts of such movies
online fashion of their proposed method enables it automatically allows us to rapidly spot essential
to process arbitrarily long videos and start patterns in the video, saving us time and effort
generating summaries before seeing the end of the from having to go through the entire content.
video. Moreover, the processing time required by
proposed method is close to the original video IV. WORK FLOW
length, achieving quasi real-time summarization
speed. The steps are followed to accomplish the transcript
information:
From [8], a generic framework of a user attention 1. Client sends request to our flask backend server
model, which estimates the attentions viewers may 2. Flask backend server asks for subtitles from the
pay to video contents is proposed. As human YouTube using YouTube API.
attention is an effective and efficient mechanism 3. YouTube sends the subtitles to our server and
for information prioritizing and filtering, user text summarization is done in our backend
attention model provides an effective approach to server
video indexing based on importance ranking. In 4. Client receives the summarized text
particular, they defined viewer attention through
multiple sensory perceptions, i.e. visual and aural
stimulus as well as partly semantic understanding.
Also, a set of modeling methods for visual and
aural attentions are proposed. As one of important
applications of user attention model, a feasible
solution of video summarization, without fully
semantic understanding of video content as well as
complex heuristic rules, is implemented to
demonstrate the effectiveness, robustness, and
generality of the user attention model. The
1207 Journal of Positive School Psychology
V. RESULTS ANALYSIS
Fig. 4: Displaying the summarized text
Summarized transcript generation using NLP and After summarization of text, the user is provided
Flask :
with four options (buttons).
In Fig. 2, the homepage of our project YouTube
[1] Translate: user can translate their
transcript summarizer with navigation bar of three
summarized text into different languages
links home, transcript now, contact us which will
provided. Fig 5 and Fig 6 shows the output for
redirect to respective pages
translating the summarized text into telugu
language
Limitations
REFERENCES
Fig. 7 Prompt allowing user for downloading file [1]. Shraddha Yadav, Arun Kumar Behra ,
in different formats Chandra Shekhar Sahu, Nilmani Chandrakar,
“ SUMMARY AND KEYWORD
EXTRACTION FROM YOUTUBE VIDEO
TRANSCRIPT”, International Research
Journal of Modernization in Engineering
Technology and Science
Volume:03/Issue:06/June-2021 Impact
Factor- 5.354 .
[2]. A. N. S. S. Vybhavi, L. V. Saroja, J. Duvvuru
and J. Bayana, "Video Transcript
Summarizer," 2022 International Mobile and
Embedded Technology Conference
Fig. 8 Prompt allowing user for sending file to (MECON), 2022, pp. 461-465, doi:
email in different formats 10.1109/MECON53876.2022.9751991.
[3]. E. Apostolidis, E. Adamantidou, A. I. Metsai,
VI. CONCLUSION V. Mezaris and I. Patras, "Video
Summarization Using Deep Neural
We developed a system for transcribing YouTube Networks: A Survey," in Proceedings of the
videos, as well as a platform that summaries the IEEE, vol. 109, no. 11, pp. 1838-1863, Nov.
transcript. We created a system with a simple user 2021, doi:10.1109/JPROC.2021.3117472.
1209 Journal of Positive School Psychology