SMART SPECTACLES

Empowering the Visually Impaired

“Innovative smart spectacles for the visually impaired with real-time face and object recognition, advanced
health monitoring, precise audio assistance, and intuitive voice command functionality."

ABHAY A V ADITHYAN P B
CEM20CS002 CEM20CS004

KRISHNARAJ R AKSHAY S NAIR

CEM20CS028 CEM20CS044

Project guide

DR. DEVI DEVAPAL

Assistant Professor
 OBJECTIVE
• Develop smart spectacles with advanced audio assistance capabilities to aid visually impaired
individuals in their surroundings.

• Implement a Personalized And Customizable Face recognition model

• Implement object recognition technology to enhance the spectacles functionality, allowing users to
identify objects and obstacles in their environment.

• Integrate health monitoring features, including temperature sensing using LM35, pulse sensing
using a pulse sensor, measuring oxygen level in blood etc.. to provide real-time health data and
alerts.

• Design a user-friendly interface using voice commands and ensure hands-free compatibility with
Raspberry Pi 4 and Pi Camera for seamless integration and optimal performance.

• Conduct user testing and feedback sessions to refine and improve the smart spectacles
functionality and usability.
PROJECT WORKFLOW

• Capture real-time video frames using Pi Camera for visual processing.

• Preprocess video data for OCR, face, and object detection.
• Implement object detection algorithms for real-time identification.
• Create face recognition module using OpenCV.
• Gather data from LM35 and pulse sensors for health monitoring.
• Process the sensor data for Realtime Health monitoring to detect variations
• Implement NLP algorithm for OCR
• Implement voice commands for control.
• Provide audio feedback based on results.
 MODULE DESCRIPTION

1. Object Detection Module

2. Face Recognition Module

3. Health Monitoring Module

4. OCR Module

5. Voice Commands Module

CIRCUIT DIAGRAM
EXPECTED RESULTS
• Realtime object recognition

• Personalized face recognition Powerbank

• Effective health assistance picamera

• Natural Language Processing Raspberry pi4

• Advanced audio assistance

LM35 SENSOR

• Hands free interaction

 Conclusion

• Our project on smart spectacles for the blind with audio assistance and health
monitoring is a significant step forward in assistive technology.

• By integrating key technologies like OCR, voice commands, face recognition, object
detection, and health monitoring, we've created a comprehensive solution for daily
challenges faced by visually impaired individuals.

• Our focus on user-friendly design and real-time feedback aims to improve

independence, safety, and overall quality of life.

• This project highlights the potential of technology to empower individuals with

disabilities and emphasizes the importance of innovation for inclusivity.
References

[1] A., Hafeez Ali et al. (2021, December 13). Real-Time Scene Analysis Using Google Glass.
National Institute of Technology Karnataka Surathkal. DOI: 10.1109/ACCESS.2.

[2] Rajendran, P. Selvi, Krishnan, Padmaveni, & Aravindhar, D. John. (2020, November 17). Voice-
Assisted Smart Glasses for the Visually Impaired. Hindustan Institute of Technology and Science,
India.

[3] Cabanillas-Carbonell, Michael, Aguilar Chávez, Alexander, & Banda Barrientos, Jeshua. (2020,
October 29-30). Glasses for Assisting the Blind with Google Vision. Universidad Autónoma del
Perú. IEEE: 978-1-7281-8803-4/20/$31.00 ©2020 IEEE 021.3135024.

[4] Son, Hojun, Krishnagiri, Divya, Jeganathan, V. Swetha, & Weiland, James (IEEE Member).
(2020, June 6). Crosswalk Guidance System for the Blind. IEEE. DOI: 78-1-7281-1990-
8/20/$31.00 ©2020 IEEE.

[5] Islam, Md. Tobibul, Ahmad, Mohiuddin, & Bappy, Akash Shingha. (2020, June 5-7). Real-Time
Family Member Recognition Using Raspberry Pi. Khulna University of Engineering & Technology,
Bangladesh. DOI: 978-1-7281-7366-5/20/$31.00 ©2020 IEEE.
 Plan of action FEBRUARY MARCH APRIL

Optical Character Recognition

Voice Commands for Assistance

Face Recognition Module

Integrate Object Detection Module

Integrate Health Monitoring Sensors

Overall Integration and Testing

Cost estimate with proper justification

Sl No Items Amount (Rs)

1 Consumables 0
26,275
2 Equipment

1000
3 Travel

4 Contingency 5000
Total 32,275

The total cost ₹32,275.

Cost estimate of Equipments

Component Cost (₹)

Raspberry Pi 4 Model B 8,000
Samsung micro-SD EVO 32GB 1,400
Pi camera 2,731
HDMI & Other peripheral cables 700
Oximetry sensor IC max30100 830
ADS1115 sensor for blood pressure measurement 634
Power Bank Battery 20000mAh 2,400
Earbuds 2,700
Frame of the spectacles to accommodate components 4480
Lm35 , Pulse sensor 1,200

Cooling System For Raspberry Pi 4 1200

The total cost of all Equipments is ₹26,275.