Visvesvaraya Technological University Belgaum-590014

A Technical Seminar Report On

“Transfer Learning for Clinical Sleep Pose Detection Using a
Single 2D IR Camera”
A Technical-Seminar report submitted in partial fulfilment of the requirements for the award
of the degree of Bachelor of Engineering in Artificial Intelligence and Machine Learning,
Visvesvaraya Technological University, Belgaum.

Submitted by:
K VAISHNAVI
1DT20AI024

Co-Ordinator
Mrs. Indu B
Assistant Professor
Dept. of AIML, DSATM

DAYANANDA SAGAR ACADEMY OF TECHNOLOGY & MANAGEMENT

Opp. Art of Living, Udayapura, Kanakapura Road, Bangalore- 560082
Affiliated to Visvesvaraya Technological University,
Belagavi and Approved by AICTE,
New Delhi
 DAYANANDA SAGAR ACADEMY OF TECHNOLOGY & MANAGEMENT
Opp. Art of Living, Udayapura, Kanakapura Road, Bangalore- 560082
Affiliated to Visvesvaraya Technological University,
Belagavi and Approved by AICTE,
New Delhi

DEPARTMENT
OF
ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING

CERTIFICATE

Certified that the Technical Seminar 18AIS84 entitled “ Transfer Learning for Clinical Sleep Pose
Detection Using a Single 2D IR Camera” carried out by SNEHA A (1DT20AI038) a bonafide
student of Dayananda Sagar Academy Of Technology & Management in partial fulfillment for the
award of Bachelor of Engineering in Artificial Intelligence and Machine Learning of the
Visvesvaraya Technological University, Belgaum during the year 2023– 2024.It is certified that all
corrections/suggestions indicated for Internal Assessment have been incorporated in the report
deposited in the departmental library. The Seminar report has been approved as it satisfies the
academic requirements in respect of Technical Seminar prescribed for the said degree.

Coordinator HOD

Prof. Indu B Dr. Sandhya N

Assistant Professor Professor & Head
Dept of AIML Dept of AIML
 ACKNOWLEDGEMENT
The joy and satisfaction that accompany the successful completion of any task would be
incomplete without the mention of those who made it possible.

I am glad to express my gratitude towards my prestigious institution Dayananda Sagar

Academy of Technology & Management for providing me with utmost knowledge,
encouragement, and the maximum facilities in undertaking this Technical Seminar.

I express my sincere thanks and gratitude to our Principal Dr. M Ravishankar for providing
me an opportunity to carry out my Technical Seminar.

I express my deepest gratitude and special thanks to Dr. Sandhya N, Professor and H.O.D,
Dept. of Artificial Intelligence and Machine Learning, for all the guidance and encouragement.

I express my sincere thanks and gratitude to our Technical Seminar Coordinator Prof. Indu B
for providing me guidance to carry out my Technical Seminar.

I am thankful to all the teaching and non-teaching staff members of Artificial Intelligence and
Machine Learning for their help and much needed support throughout the Technical Seminar.

Last but not the least, I wish to thank all my friends and family members for their help and
cooperation.

Place: Bengaluru K VAISHNAVI

Date: 4/3/2024 USN (1DT20AI024)

 ABSTRACT

Sleep quality is an important determinant of human health and wellbeing. Novel technologies
that can quantify sleep quality at scale are required to enable the diagnosis and epidemiology of
poor sleep. One important indicator of sleep quality is body posture. In this paper, we present the
design and implementation of a non-contact sleep monitoring system that analyses body posture
and movement. Supervised machine learning strategies applied to noncontact vision-based
infrared camera data using a transfer learning approach, successfully quantified sleep poses of
participants covered by a blanket. This represents the first occasion that such a machine learning
approach has been used to successfully detect four predefined poses and the empty bed state during
8-10-hour overnight sleep episodes representing a realistic domestic sleep situation.

The methodology was evaluated against manually scored sleep poses and poses estimated
using clinical polysomnography measurement technology. In a cohort of 12 healthy participants,
we find that a ResNet152 pre-trained network achieved the best performance compared with the
standard novo CNN network and other pre-trained networks. The performance of our approach
was better than other video-based methods for sleep pose estimation and produced higher
performance compared to the clinical standard for pose estimation using a polysomnography
position sensor. It can be concluded that infrared video capture coupled with deep learning AI can
be successfully used to quantify sleep poses as well as the transitions between poses in realistic
nocturnal conditions, and that this non-contact approach provides superior pose estimation
compared to currently accepted clinical methods.
 CONTENTS

CHAPTERS Page Nos

1. INTRODUCTION 1

1.1 AIM AND OBJECTIVE 2

1.2 PROBLEM STATEMENT 3

2. LITERATURE SURVEY 4

3. SYSTEM SPECIFICATIONS 6
3.1. Hardware
3.2. Software
3.3. Algorithms
3.4. Validation
3.5. Real World Testing
3.6. Deployment
4. DESIGN /METHODOLOGY 7
4.1. Data Collection
4.2. Frame Extraction & Movement Detection
4.3. Manual Scoring
4.4. Train and Test
4.5. Image Transformation Using Homography
4.6. Supervised Classification Approach
4.7 Quantifying Sleep Behavior Using Transition
5. RESULTS 14
6. CONCLUSION 16

REFERENCES 17
 LIST OF FIGURES
Fig. No Fig Name Pg. No

Fig 4.1 Examples of poses in different participants 7

Fig 4.2 The Blue graph 9

Fig 4.3 The installed camera position at the sleep lab 11
Fig 4.4 Generic five state Markov chain model 13
 LIST OF TABLES
Table. No Table name Pg.No
STATISTICAL EVALUATION 4-LAYER DE NOVO CNN
Table 5.1 14
NETWORK
Table 5.2 AVERAGE PROBABILITY MATRIX & SD OF 15
TRANSITIONS BETWEEN STATES AND OF REMAINING
IN A STATE FOR STANDARD PSG-POSITION SENSOR