Real time video surveillance with

Enhanced adaptive
Mixture of Gaussian model using WinCE

SUBMITTED BY
R.RAMYA DEVI
M.E. (EMBEDDED SYSTEM TECHNOLOGIES)
SUDHARSAN ENGINEERING COLLEGE

]
 REAL TIME VIDEO SURVEILLANCE WITH ENHANCED DAPTIVE
MIXTURES OF GAUSSIAN MODEL USING WinCE
R.RAMYA DEVI
Email:rdramyard@gmail.com
Abstract –The traffic-control and -management systems
began as basic video surveillance systems, but currently
are evolving into a fully integrated architecture of
intelligent transportation systems that incorporate new
technologies and value-added services. These ITSs use
as their basis a network capable of disseminating
comprehensive information, including real-time data and
video. The combination of networking capabilities based
on an embedded operating system and artificial vision in
a SoC-based multimedia processor will allow the imple-
mentation of advanced ITS functionalities like road-
traffic parameter estimation or incident detection. By
using a high computing power RISC processor like
OMAP with ARM core we develop the real time
video tracking using WinCE Since WinCE has
much user friendly APIs,Include the new concept of
Enhanced Adaptive Mixture of Gaussians model
while developing a application code as background
subtraction algorithm, proposed algorithm apply
different weight-age for different image captured
condition and do self learning based on previous
samples taken and treat them each time as
individual sample irrespective of foreground or
background image
I INTRODUCTION
The continuing progress in semiconductor tech-
nology, the ubiquity of digital technologies and
communications, and the development of
sophisticated artificial vision techniques define a
new market context with a clear demand for
embedded multimedia processors. Media processors
are specifically designed for the creation and
distribution of digital media. They typically are
used in multimedia processing environments to cap-
ture, store, manipulate, and transmit multimedia
objects such as text, handwritten data, audio
objects, still images, 2D/3D graphics, animation,
and full-motion video,1 as the “Smart
Environments Based on Embedded Multimedia
Processors”
One of the most popular and cost-efficient
approaches to media-processing architectures
consists of a system-on-chip (SoC) architecture
based on a general-purpose RISC processor. These
systems compensate for the lack of media
applications’ specialized support by
incorporating a set of peripherals like video
and audio ports, compression and video
processing units, and interfaces to popular
massive storage devices, keyboards, and LCD
or CRT screens.2
In addition, multimedia applications also
demand networking with multitasking and
multithreading capabilities, and the
implementation of Web service applications
like remote login for configuration,
maintenance, or upgrading purposes. All these
requirements are forcing the use of an
operating system, and RISC processors are
particularly well suited for running such
systems.3 Consequently, SoC technology-
based multimedia processors provide the cor-
rect solution for many multimedia
applications.
II SYSTEM REQUIREMENTS
Embedded multimedia processors are
expected to form the basis of future ITS
electronic installations. From a hardware
viewpoint, a RISC processor provides the
multimedia processor’s core component. It
can easily support anything from an operating
system for managing interfaces to
communication channels like Ethernet and
wireless devices to massive storage devices
like memory card/secure digital controllers,
USB pen drives, and digital I/O or LCD
screens. The multimedia processor also
includes special support for video
applications. Hence, as Figure 1 shows, its
architecture includes some fixed-function
engines.
Video ports are usually provided to acquire
BT656 or raw data streams and deliver them
to the media processor, typically in either an
RGB or YUV color space, with Y the
luminance component and U and V the
chrominance components.4 These ports
usually incorporate different processing and
encoder/decoder video modules to provide video
acceleration and offload the CPU from intensive
computational tasks. For example, they can include
processor modules to allow resizing images and
color space conversion, or encoder and decoder
modules to provide hardware support for
implementing the encoding and decoding of a
video, such as MPEG-4.
From a software viewpoint, embedded processors
should incorporate not only computationally
intensive algorithms to allow traffic-parameter
estimation or incident detection, but also standard
communication. Protocols, interfaces to data
storage media such as USB and MultiMedia Card,
wireless connectivity via Bluetooth, FTP and SSH
servers for software upgrading, and a Web server
for remote configuration. These complexities make
it advisable to use an embedded operating system
that lets application programmers focus on higher-
level functionalities, like those based on artificial
vision techniques.
The selected operating system should support
preemptive multitasking or multithreading and
device drivers for required connectivity. In this
context, RISC processors are especially well suited
for running such an operating system, offering a
wide spectrum of choices for both open
source (Linux) or proprietary (Windows CE)
applications. Figure 1b shows the kernel and the
main components found on embedded operating
systems. The block labeled “other components”
refers to specific drivers for video encoder/decoder
and processing units, typically provided by the
media processor’s vendor.
III PROTOCOL IMPLEMENTATION
. background model. The final goal involves
Region-based data estimation techniques require the
detection of both moving vehicles and short-term
still vehicles. Specific algorithms operate behind
the described traffic-data estimation, including
background subtraction, shadow removal,
robustness under progressive or sudden changes in
lighting conditions, and more basic and general
algorithms like edge detection, neighborhood
operations, image labeling, or image thresholding.
The background-subtraction and shadow-removal
algorithms are among the most prominent
implemented in the system. Both require rather
complex heuristics and intensive floating-point
computation.
The background subtraction technique allows
extracting a moving object from an image
sequence obtained using a static camera. This
should be accomplished even with objects
permanently moving around in the scene. It is
based on the estimation of the scene’s
background model. This model obtains a
reference image and compares it to each
recorded image. Consequently, the
background model must be a representation of
the scene after removing all nonstationary
elements, and it must be permanently updated
to take into account the changing lighting
conditions or any background texture
changes.
Researchers have conducted several surveys
and comparisons of different algorithms for
background subtraction.6 In particular, an
improvement to the sigma-delta background
estimation algorithm has been implemented.7
In its original form, this technique provides a
valid background model of the scene—
assuming that, at the pixel level, the
background intensities are present most of the
time. However, this background model
degrades quickly under congested traffic
conditions due to integration of the pixel
values belonging to the foreground vehicles.
The improved version defines a numerical
certainty level tied to each pixel in the current
background model to avoid this problem. The
higher the certainty level, the lower the
updating need for the corresponding pixel.
This additional heuristic achieves a proper
balance between adaptation to illumination
changes in the scene or changes in the
background texture and robustness of the
preserving the model from corruption caused
by slowly moving vehicles or vehicles that
remain motionless for a time.
IV BACKGROUND SUBTRACTION
Identifying moving objects from a video
sequence is a fundamental and critical task in
many computer-vision applications. A
common approach is to perform background
subtraction, which identifies moving objects
from the portion of a video frame that differs
significantly from a background model. There
are many challenges in developing a good
background subtraction algorithm. First, it
must be robust against changes in
illumination. Second, it should avoid detecting non-
stationary background objects such as moving
leaves, rain, snow, and shadows cast by moving
objects. Finally, its internal background model
should react quickly to changes in background such
as starting and stopping of vehicles.
The objects in motion can be easily grabbed
bysubtracting the foreground image from the
background estimated.The simplest way of
background estimation is using a pre-recorded
background image.Uses a reference background
image for comparison purposes.Current image
(containing target object) is compared to reference
image pixel by pixel.Places where there are
b) Current Image
differences are detected and classified as moving
objects.

c)Subtracted pixel range

Video Encoding and Decoding

Figure 1-a)Background Image
In general, video encoding and decoding on
the OMAP5910 consist of three phases. The
first phase is video pre-processing where the
data captured needs to be converted to the
encoder input format, second phase is doing
the actual video encoding and decoding, and
third stage is video post-processing where the
decoded data is converted to the LCD input
format.The video encoder implemented
requires a YUV 4:2:0 non-interface video
input and, therefore,pre-processing of the
video input may be required depending on the
application. For the video ecoder, post-
processing is needed to convert the decoded
YUV 4:2:0 data to RGB for displaying. Pre-
processing:YUV 4:2:2 interlaced (from
camera for example) to YUV 4:2:0 non-interlaced,
only decimation and no filtering of the UV
components.• Post-processing:YUV 4:2:0 to RGB
conversion Display formats of 16 bits or 12 bits
RGB 0 to 90 degrees rotation for landscape and
portrait displays,• MPEG-4 Simple Profile Level 0,
Level 1 and Level 2 support, H.263 and MPEG-4
decoder and encoder compliant, MPEG-4video
decoder options are:AC/DC prediction-Reversible
Variable Length Coding (RVLC)-
Resynchronization Marker (RM)
Data Partitioning(DP).rror concealment, proprietary
techniques4 Motion Vectors per Macroblock
(4MV)-Unrestricted Motion Compensation-Decode
VOS layers
• MPEG-4 video encoder options are: Reversible
Variable Length Coding (RVLC)-
Resynchronization Marker (RM)-Data Partitioning
(DP)-Motion Vectors per Macro block (4MV)
-Header Extension Codes-Bit rate target change
during encoding-Coding frame rate change during
encoding-Insertion or not of Visual Object
Sequence start code
• Insertion of I-frame during the encoding of a
sequence suppor
t• Encoder Adaptive Intra Refresh (AIR) support•
Multi-codec support, multiple codecs running from
the same code
Pixel Representation
Red, Green and Blue or RGB are the primary colors
for the computer display and the color
depth supported by the OMAP5910 is
programmable up to 16 bits per pixel, RGB565 (5
bits for Red, 6 bits for Green and 5 bits for Blue).
In the consumer video such as DVD, camera,
digital TV and others, the common color coding
scheme is YCbCr where Y is the luminance,
Cb is the blue chrominance and Cr is the red
chrominance. Human eyes are much more
sensitive to the Y component of the video and
this enables video sub-sampling to reduce the
chrominance component without being
detected by the human eyes. This method is
referred to as YCbCr 4:2:0, YCbCr 4:2:2 or
YCbCr 4:4:4.Figure 1 shows the sub-
sampling techniques applied to the video. In
the OMAP5910 design, for the decoded video
to be displayed, post-processing is needed to
calculate the RGB values equivalent of the
YCbCr data. The post-processing engine
computesthe following equations to obtain the
gamma-corrected RGB information.
• R = Y + 1.371(Cr – 128)
• G = Y – 0.698(Cr – 128) – 0.336(Cb – 128)
• B = Y + 1.732(Cb – 128)
Refer to the NDA only specification of the
test code implemented to demonstrate the
pre-processing and post-processing for
MPEG-4 encoder and decoder.
V REFERENCE
Michalopoulos
P.Raghavan
Manzanera and J.Richefeu