Professional Documents
Culture Documents
Tom Keating Eugene Research Institute Ray Keating Pontimax Technologies, Inc
Tom Keating Eugene Research Institute Ray Keating Pontimax Technologies, Inc
Caregiving System
Tom Keating
Eugene Research Institute
Ray Keating
Pontimax Technologies, Inc.
Remote Caregiving Support
• Applications:
- Providing long distance behavioral support
- Helping avoid victimization
- Monitoring physical health and communicating information to
health care providers
- Monitoring environmental changes related to health and safety
Test Bed Example of Remote
Monitoring in Practice
Main Components
Picture Planner™ activity planning and prompting
application
X10-based home sensor network
Home automation software
Consumer and caregiver monitoring computers
Intelligent activity recognition software
Webcams or IP Cameras
Apartment Layout
7 PIR motion sensors
1 magnetic reed sensor
CM15 powerline
interface
Remote Desktop View
Web Portal for Caregiver
Bath
Shower
Bdr
LR
DR
Porch
Fr. dr.
Kitchen
Summaries
______________________M_____T____W____Th____F____S____S
u
Showers 1 1 0 1 0 1 0
Sleep hours 6.5 12 7 8 8.5 8.5 6
Nighttime door 0 0 0 0 0 0 0
Nighttime bath use 2 1 1 1 2 3 1
Benefits
• Improved self-management for activity and task
completion
• Feasible universally cost effective remote support
technology
• Caregiver effectiveness increased
• Caregiver peace of mind increased
• Some functionality increasingly available “off the
shelf”
Smart Prompting Prototype:
Planned Activity vs. Actual Behavior
Conceptual Model for Behavioral
Inferencing in Residential Settings
Behavioral Inferencing for
Activities of Daily Living
The “Sensible”
Spatio-Temporal Way
Objective 1
Provide near real time oversight of consumer in
their activities of daily living by:
• Are inconspicuous
• “Sensibility”
– Do ADL have characteristic patterns in the form of
spatio-temporal motion occurrences?
– What would these ADL characteristics be based on?
Can the ADL be Captured by
Motion Sensors?
• To answer the question…
• Sensing Capabilities
– Installed PIR sensors fire once every ten
seconds for motions in FOV
– Motions continuously detected for all
domain areas
Capturing the ADL Motion Data,
Con’t.
• Real time data collection
– Consumer site unit receives transmitted sensor motion data
– Time stamps location tagged motion data
– Continuous uploading to database server
• Results:
The basic spatio-temporal “shower taken” pattern
confirmed, albeit, at a lower occurrence rate of 30 to 60
occurrences over a five to ten minute duration.
How do we Apply our ADL Fact
Patterns to the Data?
• Three requirements:
– Describe the spatio-temporal fact patterns
– Store them for access from the database
– Use them to inference ADL occurrences
Use Spatio-Temporal Predicate
Expressions to Specify the ADL Patterns
• General form:
– @Pattern Meta Function [tag-value argument set]:
• Spatio-temporal context (tag-value context reference:value
set)
– Predicate Operator (=,>=,<=, !=)
– ! Pattern Meta Criterion [criterion argument(s)]:
• Spatio-temporal context (tag-value context reference:value
set)
• Showering_Activity:
@OCCURRENCES[SCANFREQ=’10’,DURATION=’10’]:
CONTEXT(LOCATION=‘SHOWER‘, TIMESCOPE=‘2000-2200’ )
>= !OCCURRENCES[CRITERION_OCCURRENCES,CRITERION_DURATION]:
CONTEXT(LOCATION=‘SHOWER', TIMEFRAME=‘0000-2400’)
CAUTION:
• Many ADL patterns can’t be reliably inferred by just
a single motion pattern
• Can the Level of “Sensibility” be raised?
– Sure, just specify additional inferencing patterns
to form a predicate inferencing chain:
• If fact pattern-1, then if fact pattern-N…
• CONTINUOUS_PRESENCE-SHOWER:
@DURATION[SPAN='CONTINUOUS']:CONTEXT(LOCATION=
‘SHOWER',TENSE='CURRENT')
>=
!DURATION[ACTUAL_DURATION]:CONTEXT
(LOCATION=‘SHOWER',TEMPORAL='CURRENT')
Inference Chaining of ADL
Predicate Patterns
• A “shower taken” is now defined as:
Shower_Taken
• rayk@pontimax.com