ARTIFICIAL PASSENGER

presented by
Y VIGNYA
(18KN1A0560)

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

NRI INSTITUTE OF TECHNOLOGY
(ACCREDITED BY NBA:CSE,ECE &EEE)
AN AUTONOMOUS INSTITUTION, PERMANENTLY AFFILIATED TO JNTUK, KAKINADA
(ACCREDITED BY NAAC WITH ”A” GRADE AND ISO 9001:2015 CERTIFIED INSTITUTION)
CONTENTS
 Abstract
 Existing System
 Proposed System
 Device Setup
 System Architecture
 Functions
 Working Components
 Applications
 Conclusion
 Future Enhancement
 ABSTRACT
• The Artificial Passenger(AP) is a device that would be used in
a motor vehicle to make sure that the driver stays awake.

• IBM company has developed a prototype that holds a

conversation with a driver like..telling jokes and asking
questions intended to determine whether the driver can respond
alertly enough!

• The conversation would be based on personalized profile of the

driver.
 EXISTING SYSTEM
 Due to drowsiness, around 20% of road accidents are taking
place in an year.

 Also having more number of beverages like Tea, coffee etc… to

stay awake causes health issues.

 It is also because of drunkard people that they distract people

lifestyle.
 PROPOSED SYSTEM
 The Artificial Passenger is an artificial intelligence – based
companion.

 That will be resident in software and chips embedded in the

automobile dashboard.

 Natural Language E – companion.

 “Sleep Prevention Dialogue Based Car” and Life Safety system.

 DEVICE SETUP

Showing the dashboard of the car where the whole

artificial system is generally attached
 SYSTEM ARCHITECTURE
Server

Microphone
Network

Camera
Temperature
indicator
Artificial
Passenger

Speaker
Door lock

Key Odour sensor

 FUNCTIONS
 Detects alarm conditions through sensors.

 Broadcasts pre – stored voice messages over the speakers.

 Captures images of the driver.

 Improvement for the accuracy of the speech recognition.

 Track the lip movements of the driver.

 WORKING COMPONENTS
1. Automatic speech recognizer (ASR)
2. Natural Language Processor
3. Driver analyzer
4. Conversational Planner(CP)
5. Alarm
6. Microphone
7. Camera
8. Odour sensor
Automatic Speech Recognizer(ASR) :-
There are two ASRs used in the system:

 First one is “speaker independent” and used for decoding

video signals of the driver.

 Second one operates with voice car media and decodes

tapes, audio book, telephone mails etc..
Natural Language Processor :-

 Processes the decoded signals of textual data provided from the

ASR.

 Identifies related meanings from the contents of the decoded

messages.

 Produces variant of responses.

 This output goes to the driver analyzer as an input.

Driver Analyzer :-

 Receives the textual data and voice data.

 Measures the time response using a clock.

 It detects slow responses, lack of intonation and his condition.

 Time responses, conclusions about driver’s alertness will give

output to the conversational planner.
Conversational Planner(CP) :-

 It is the heart of the system.

 Instructs the language generator to produce the response.

 If the driver is in good state, CP instructs the language

generator to continue the conversation. Otherwise it is
instructed to change the conversation.
Alarm :-

 If the CP(conversational planner) receives information that the

driver is about to fall asleep an alarm system is activated.
 We should program as we want these speakers to increase
background music or a sound buzzer or to open and close all the
windows automatically or even spray the driver with ice water.
Microphone :-

For picking up the words and separate them by some

internally used software for conversation.
Camera :-

 It will capture images of the driver.

 Determining frequency of eye blinking, closing and yawning of

the driver within the selected time period.

 Tracks the lip movements of the driver.

Odour Sensor :-

 The system also detect whether a driver is drunken or have

taken drugs.

 If driver is drunk, it sends a signal to vehicles nearby so that

there driver becomes alert.
 APPLICATIONS
 Prevents the driver, falling asleep during long and solo trip.

 If a driver is drunken, it sends a signal to vehicles nearby so

that there driver becomes alert.

 Opens and closes the windows and answers a call for you.

 It is also used for the entertainment.

 CONCLUSION
Successful implementation of artificial passenger would allow
use of various services like reading emails, navigation,
downloading music files, voice games without compromising
a driver safety.
 FUTURE ENHANCEMENT
Shortest-time routing based on road conditions changing
because of weather and traffic, information about the cars on
the route, destination requirement.