SmartCatch Systems

Putting Intelligence into Surveillance

19th Annual NDIA Security Technology Symposium

June 16-19, 2003

Brooks McChesney
Entrepreneur-in-Residence
NEC USA Inc
brooks@ccrl.sj.nec.com (408-863-6017)
Smart Surveillance: Features & Benefits

• Video intelligence software that detects, identifies

and tracks objects within existing CCTV systems
– Monitors events in real time to insure activities are limited
to specific tasks & within authorized areas of authority
– Automatically detects suspicious behaviors and other
violations of established security policies and procedures
– Distinguishes between objects: person(s), bag(s), vehicles,
etc.
– Sounds alerts & alarms according to user escalation
procedures
– Supports incident analysis and forensic search (in real time
or via preserved archives)
– Maintains confidentiality through restricted user and role
based access
The New Face of Physical Security
Then
• Reliance upon semi-
skilled guards with 90-
100% turnover and whose
costs exceeds that of
products & systems
• A highly fragmented,
unstable industry
• Products typically passive,
standalone sensors
• Thinking in terms of
borders, fences & doors
New Focus
• Reduce people cost with smart
technology
• Integrate systems with advanced
surveillance technology
• Prevent actions of those who
pose a threat while facilitating
actions of the honest majority
• Elevate operational effectiveness
& efficiency
• Deploy human-centric framework
that can associate actions with
identity, behavior and credentials
 Human Costs of Security

Total Security Market Guard Cost

(staff one post, 24/7 at one facility)

In-House
Guard Annual Annual
$11B
Position Staff Salary Cost
Security
Contract
Guard Guard 5 X $26,628 = $133,140
$11B Security
Director 1 X $64,133 = $64,133
Your
Current
Products & Costs $197,273
Systems
$19B

Source : JP Freeman, GE, Security magazine, OnGuard.Net

Typical Airport Model

Perimeter
Defense
Zone

Perimeter
Defense
Zone
Airport Examples

• Unattended baggage
– PanAm Lockerbie disaster: Heathrow Airport
• Unidentified person walks around the security gate
– Denver Airport, August 2002
• Unidentified person in unauthorized AOA
– Detroit Metro Airport , May 2002
• Piggybacking/Tailgating at secure access points
• Failure to recognize unattended vehicles
– Louisville Intl. Airport, Sept 2001
• Unidentified person gains access to the runway and stows
away
– Logan International Airport, Sept 1999
• Unidentified person disappears in the parking lot
• Suspicious movement against normal traffic patterns
Application areas

Perimeter Monitoring

Security Checkpoint Monitoring

System Overview

Central Matrix Switch

Live Camera ALERTS

Feeds SmartCatch
Vision
RULES

Card Reader
signal

Card Reader Biometrics

Door Alarm

Card Reader Biometrics Door Alarm

Database Database Database
SFO requirements

• Detect tailgating: more than one person

enters the door with one card swipe.
• Detect piggybacking: one person swipes
the card and another person enters the
door.
• Detect abnormal behaviors:
– Person swiping the card many times.
– Person loitering in front of the door.
Output from SFO

ALARM ALARM

ALARM ALARM
 0
1
2
3
4
5
6
7
4/
8
4/4/9
4/10
4/11
4/12
4/13
4/14
4/15
4/16
4/17

Violations
4/18
4/19
4/20
4/21
4/22
4/23
4/24
4/25
4/26
4/29
3
5/0
5/1

Suspicious events
5/2
5/3
5/4
5/5
5/6
SFO Airport Results

5/7
58
5/ /9
5/10
5/11

False Alerts
5/12
5/13
5/14
SmartCatch SFO Airport Results

5/15
5/16
5/17
5/18
5/19
5/20
5/21
5/22
5/23
5/24
No. of Card Swipes

5/25
5/26
5/27
28
0
50
100
150
200
250
300
350
400
450
SmartCatch Algorithms

Background
modeling
Card reader
Palm reader

Object Motion
detection detection

Object Event
tracking detection
SmartCatch Differentiators
Limitations of the current systems
• Difficulties of human tracking: non-rigid motion, changing
image size, occlusion and intersections
• Unable to handle changing shape in relation to camera angle
• Generates very high false alerts
• Cannot handle cluttered environment with multiple objects

SmartCatch Approach
• Neural Network that handles both humans and non-humans in
cluttered envionrments
• Tight Integration of Object detection & tracking resulting in very
high system accuracy
• Robust object classification engine
• Background modeling that automatically adjusts to changing
lighting conditions
• Real-time processing speed
SmartCatch: Benefits

• Provides a quantifiable increase in security

• Increases public/employee confidence
• Provides 24x7 protection without delays or
inconvenience to customers or employees
• Reduces risks of liability
• Increases operational efficiency