“Facial Expression Emotion Recognition in Human-

Robot Interaction System”

Presented by Guided By:Prof.Prachi Bhagat
1.RUSHIKESH THANEKAR T2010121612017
2.ACHAL NEET T2010121612027
3.ANIKET KULAL T2110121372502
4.NAYAN SELUSKAR T2110121372503
Content
1. Introduction
2. Methodology
3. Architecture
4. Limitation
5. Application
6. Future work
7. Future Prospect
8. Conclusion
9. Reference
Introduction
Robots are no longer just machines being used in factories and industries. There is a
growing need and demand towards robots sharing space with humans as collaborative
robotics or assistive robotics. Robots are, now, increasingly being deployed in a variety of
domains as receptionists, educational tutors, household supporters and caretakers.

Thus, there is a need for these social robots to effectively interact with humans, both
verbally and non-verbally.
Facial expressions are non-verbal signals that can be used to indicate one’s current status
in
a conversation.

Facial expressions are an ideal means of communicating one’s emotions or intentions to

others.
Methodology
1. Data Collection:

Gather a diverse dataset of facial images or videos depicting various emotional

Expressions.

This dataset should encompass a wide range of individuals,expressions, poses,

and lighting conditions to ensure robustness and generalization of the FEER
system.

Annotate the dataset with ground truth labels indicating the corresponding
emotions expressed in each image or video frame.
2. Preprocessing:

Perform preprocessing steps to enhance the quality and consistency of the

input data. This may include facial landmark detection, face alignment,
normalization, and image augmentation techniques to reduce variability and
improve model robustness.

3. Feature Extraction:

Extract discriminative features from the preprocessed facial images or video

frames. This can involve various techniques such as geometric features,
texture descriptors, facial action units (AUs), or deep learning-based feature
representations obtained.
 ★ System Architecture Design:

1.Input Images
2.Face Acquisition
3.Face Detection
4.Pre-Processing
5.Feature Extraction and
Representation
6.Feature Classification
7.Output Recognized Emotion
★ Challenges and Limitation

1.Cultural and Individual Variations

Emotion recognition systems must account for cultural differences and individual variations
in expressing and perceiving emotions, presenting challenges in developing universally
effective systems.

2.Ethical Considerations

The use of emotion recognition technology raises ethical concerns related to privacy,
consent, and potential misuse, necessitating careful consideration and responsible
deployment.
★ Applications of Facial Expression Emotion Recognition

1.Personalized Interaction:Facial expression recognition enables robots to personalize

interactions based on human emotions, enhancing user engagement.

2.Adaptive Responses:Emotion recognition technology allows robots to adapt their

responses to human emotions, creating more natural and empathetic interactions

3.Emotional Feedback:Robots can provide emotional feedback based on human

expressions, fostering better communication and understanding in human-robot
interactions

4.Improves User Experience:Case studies demonstrate the positive impact of emotion

recognition on user experience, leading to enhanced satisfaction and engagement
Future Work
1. Exploring multi-modal fusion for improved emotion recognition.
2. Studying long-term interaction dynamics to adapt to changing affective states.
3. Addressing cross-cultural adaptation for diverse user populations.
4. Considering ethical and social implications, ensuring responsible deployment.
5. Validating systems in real-world settings and enhancing user experience.
6. Personalizing interaction based on individual preferences and context.
7. Promoting interdisciplinary collaboration to advance research in the field
Future Prospects
1.Empowering Educational Robotics

Emotion recognition technology holds the potential to empower educational robotics,

enhancing their ability to support students' emotional well-being, learning experiences,
and inclusive education

2.Ethical Imperatives

As we embrace the future of emotion recognition in human- robot interaction, ethical

considerations, user- centric design, and responsible deployment will be paramount in
shaping its impact on education.
Conclusion
1.In conclusion, the development of a Facial Expression Emotion Recognition (FEER) based
Human-Robot Interaction (HRI) system represents a significant advancement in enhancing
the naturalness, effectiveness, and adaptability of interactions between humans and
robots.

2.Through the integration of machine learning algorithms, real-time processing techniques,

and user-centric design principles, the FEER system enables robots to perceive and respond
to human emotions accurately and empathetically.
References
1.Liu, Z., Wu, M., Cao, W., Chen, L., Xu, J., Zhang,R., Zhou, M. and Mao, J., 2017. A facial
expression emotion recognition based human- robot interaction system. IEEE CAA J.
Autom. Sinica,4(4), pp.668 676.

2.Ioannou, S.V., Raouzaiou, A.T., Tzouvaras, V.A.,Mailis, T.P., Karpouzis, K.C. and Kollias,
S.D.,
2005. Emotion recognition through facial expression analysis based on a neurofuzzy
network. Neural Networks, 18(4), pp.423-435.

3.Abdat, F., Maaoui, C. and Pruski, A., 2011,November. Human-computer interaction

usingemotion recognition from facial expression. In 2011 UKSim 5th European Symposium
on Computer Modeling and Simulation (pp.196-201) IEEE.
Thank You