Professional Documents
Culture Documents
Yuan 2010
Yuan 2010
DOI 10.1007/s00138-010-0276-x
ORIGINAL PAPER
Received: 26 June 2008 / Accepted: 28 July 2009 / Published online: 15 June 2010
© Springer-Verlag 2010
Abstract An integrated system based on video surveillance be installed in the close proximity of fires; otherwise fire
is presented for automatic fire detection and suppression. The cannot be detected at all. Therefore, these detectors cannot be
system is composed of two modules, including fire detection successfully applied in large or open spaces. Those detectors
and fire suppression. The fire detection module makes full use are often rendered invalid by dust or other non-fire particles
of traditional CCD cameras for fire recognition. Some spatio- due to long-term direct contact with those particles. Some
temporal features, such as color and motion, are extracted to detectors make use of infrared sensors, but that leads to high
detect fire in real time by utilizing sequential image process- cost for surveillance.
ing techniques. Once a fire is detected, the system will control Up to now, video surveillance is widely used in commer-
the fire suppression module to extinguish the fire automati- cial and military fields [2] such as traffic [3], portable applica-
cally. It mainly consists of control device, mobile device, and tions [4]. Video fire detection has been proposed to solve the
water gun. Experiments performed in a large space hall show aforementioned problems. It not only detects a fire far from
that the integrated system can detect a fire about a few seconds cameras, but also provides visual information about the fire.
after ignition and automatically suppress the fire quickly. Video fire detection can easily integrate fire safety into con-
ventional public security by fully utilizing surveillance hard-
Keywords Video surveillance · Fire detection · ware that is widely available. According to detected objects,
Fire suppression · Motion detection it can be classified into two categories: video flame detection
and video smoke detection.
123
942 F. Yuan
to generate a color lookup table of fire pixel and then tem- system detected more fires and faster than the traditional
poral variation of pixel values was extracted to determine fire detection systems. In order to develop novel techniques
whether there was a fire pixel or not. The method is insensi- for video smoke detection, Xiong et al. [22] adopted back-
tive to the motion of camera. But it cannot segment fire pix- ground subtraction, flickering extraction, contour initiali-
els well when there are fire-colored objects. Motion, flicker, zation, and contour classification using both heuristic and
edge blurring, and color features can be combined together empirical knowledge about smoke. Toreyin and Cetin [23]
for flame and smoke detection [8]. Healey et al. [9] used var- presented a wildfire detection algorithm using LMS-based
iable size rectangles to ensure that their algorithm is equally active learning. I proposed a transparent model [24] and a
sensitive to the same size fire. Several tests were applied to motion model [25] for smoke detection.
each pixel within every rectangle and then connected compo-
nent analysis was followed. Toreyin et al. [10,11] presented
1.3 Fire suppression
an infrared video based flame detection method using hid-
den Markov model, and wavelet analysis. Yuan et al. [12]
Fire suppression systems often use water and foam to
also proposed a flame detection method based on Gaussian
extinguish fires. Water has become the most widely used
mixture model.
fire-fighting agent due to its nice performance of fire sup-
pression. The principle of water is the removal of heat from
1.2 Video smoke detection
the fire through their heat capacity and latent heat of vaporiza-
tion [26]. Therefore, water-based fire suppression systems are
In most cases, fires are developing from smouldering. Smoke
usually applied in most cases of non-electricity fires. Water
often appears during that stage. So detection of smoke pro-
has various popular modalities for fire suppression, such as
vides an earlier alarm of fire. Smoke detection can be mainly
high-pressure water spray, water mist [27], and so on. Most
classified as three categories [13–16]. The first category is the
of these systems are usually installed on a fixed location.
histogram-based smoke detection. The histogram of color is
These fixed-location systems monitor limited ranges. A fire
used to detect the presence of smoke in videos. Several statis-
suppression system based on water spraying was developed
tical measures, such as mean and standard deviation, are com-
by the State Key Lab of Fire Science [28]. The system can
puted to determine the probability of the presence of smoke.
be controlled by computers. It can automatically search the
The second one is temporal analysis-based techniques. Direct
location of fire and guide the water gun to point to the fire,
differences of successive frames and wavelet transform of
in order to suppress fire rapidly. Recently, the system was
temporal values of pixels are used to extract time-varying
further developed to be able to move the water gun along a
features. The third one is rule-based techniques [17]. Knowl-
fixed path under control of computer. Thus, the system can
edge of fire is coded as some rules to infer the presence of
monitor large ranges of scene.
smoke. Some approaches utilized combined techniques to
In this paper, I mainly focus on investigating video-based
determine the appearance of smoke. When there is smoke in
fire detection and integrating our algorithm into the mobile
a scene, edges of the scene will lose their sharpness and the
fire suppression system. The main contribution of this paper
scene becomes grayish. So Toreyin, Dedeoglu, and Cetin [18]
is integration of the two systems.
extracted such features to monitor possible decreases in both
This paper is organized as follows: in Sect. 2, the system is
high-frequency content and chrominance values of pixels.
described in detail; in Sect. 3, implementation of the system
They presented contour-based smoke detection method using
is presented; Sect. 4 gives experimental results; in Sect. 5,
wavelet transform. Guillemant and Vicente [19] used tem-
the paper is concluded.
poral embedding of gray-levels, fractal indexing of points,
chaining points into a linked list and motion extraction from
point sequences of the linked list for forest smoke detec-
tion. Because smoke is similar to steam in appearance, steam 2 System description
detection is also introduced. Ferrari et al. [20] presented a
real-time image processing technique for the detection of Figure 1 shows the integrated system based on video sur-
steam in video images. In their method, a statistical Hidden veillance for automatic fire detection and suppression. The
Markov Tree (HMT) model derived from the coefficients system includes fire detection and suppression modules. The
of the dual-tree complex wavelet transform (DT-CWT) in former module is mainly composed of CCD cameras, video
small local regions of the image sequences is used to char- servers, and image processing computers. Our system is able
acterize the steam texture pattern. An SVM classifier is used to directly utilize video surveillance hardware which was
to detect steam. Gottuk et al. [21] evaluated the effective- installed originally for security. When the fire detection finds
ness of commercial video image fire detection systems for a fire, it will control the fire suppression module to automat-
small, cluttered spaces on Navy ships. They found that the ically extinguish fire.
123
An integrated fire detection and suppression system based on widely available video surveillance 943
− 1 (X−μ)T −1 (X−μ)
detection. The system can be installed in large or open spaces. η X, μ, =
1/2 e 2 (2)
My fire detection module uses a 4-path video card for real- (2π ) D/2
time image captures. Where D is the dimension of color values, D often equals
three for chromatic pixels and one for gray scale pixels. K
3.2 Flame detection is determined by the available memory and computational
power, currently from 3 to 5.
As shown in Fig. 2, color values at the same position are Dynamic feature is the fluctuation of shape. To measure
automatically recorded per frame by our developed software. this feature, we pay more attention to area and shape of fire
Figure 2 shows fluctuation chart of pixel intensity in the RGB region. Only early warning of fire is significant for fire sup-
channel. X-coordinate is the frame number and y-coordinate pression. When the area of fire region is larger than some
corresponds to intensities of R, G, and B values. For exam- threshold and then tends to expand, there are possible fire
ple, red green, and blue points stand for different intensities events occurring. Fire shape changes frequently over time,
of R, G, and B components, respectively. We take advan- while shapes of sun, flashlight and other artificial light often
tage of Gaussian mixture model and frame difference tech- change slowly.
niques to adaptively extract a background image from image
sequences captured by CCD color cameras [12]. An adaptive 3.3 Smoke detection
background model is able to mostly eliminate influences of
artificial lights, wind, and moving object disturbance. Fore- Smoke detection is relatively more difficult than flame
ground objects, which are possible fire pixels, are obtained because smoke reduces image contrast. Therefore, most
by subtracting the background image from the current frame. background estimation methods cannot obtain good results.
Color, shape fluctuation, and growth rate are used to deter- As shown in Fig. 3, the sequential images are processed
mine if a possible pixel is an actual fire pixel. in the following stages: motion detection, color detection,
When there is no fire, pixel values (R, G, B) match a motion feature extraction, and recognition [25]. The algo-
Gaussian distribution with a low mean value. Once fire is rithm is briefly described in the following paragraphs:
123
944 F. Yuan
Sequential
images
No
Motion detection
Yes
No
Color detection
Yes
Motion feature
extraction Fig. 4 Searching scheme
No
Classifying
Yes
Fire alarm
Motion plays an important role in video smoke detection. The concept of integral image was first introduced by Viola
There are many methods [30] proposed for motion esti- and Jones [31] and further developed by Lienhart et al. [32].
mation, such as optical flow. Most of them are prohibitive The integral image techniques greatly speed up extraction of
because it is time consuming. I take advantages of the Sum rectangular features, and it is widely applied in many areas,
of Absolute Difference (SAD, Eq. 3) as a matching crite- such as face detection. To speed up motion estimation, the
rion using a searching scheme as shown in Fig. 4 to estimate integral image technique can be used to compute the sum
motion. Motion parameters (i, j) with minimum value SAD of absolute difference. But the accuracy is degraded due to
are regarded as velocity of that block (Eq. 4). The orientation integral image.
of velocity is discretized into eight directions which are 0◦ , Figure 6 shows experimental results of motion features
45◦ , 90◦ , 135◦ , 180◦ , 225◦ , 270◦ , and 315◦ . These discrete extracted by our algorithm. In the 1st row of Fig. 6, the
directions are coded as 1, 2, 3, 4, 5, 6, 7, and 8, respec- accumulative motion orientation is marked by blue to red
tively. If a block is stationary or the parameters of velocity arrows. Blue arrow stands for accumulation equal to a spec-
are (0, 0), the direction is coded as 0. This processing can be ified threshold Ta and red one stands for maximum accu-
formulated as mulation 1.0. Arrows with blue-red gradual changing color
123
An integrated fire detection and suppression system based on widely available video surveillance 945
123
946 F. Yuan
Because the communications utilize COM port, the Table 1 Smoke experiments
control program must be written using the RS232 proto- Combustible Environment Smoke size Response
col. The fire suppression module has its own control pro- time (s)
tocol. According to the control protocol, the control program
Dry leaves Outdoors, wind Large 7.6
is written and integrated into the fire detection software.
Gasoline Outdoors, no wind Large 3.96
Because the system requires frequent status enquiry about
the fire suppression model in real time, the control program Gasoline Indoors Small 8.6
is running on the background in a newly created thread while Cotton ropes Outdoors, wind Medium 3.96
video fire detection is running on another thread at the same
time at 25 frames per second.
4 Experiments
123
An integrated fire detection and suppression system based on widely available video surveillance 947
Table 2 Non-smoke
experiments Object type Environment Image size of Total frame Frame number of
object number false alarm
module did not raise any fire alarms, and the fire suppression
module did not start to work for fire extinguishing. the experimental scene in advance. About 1 liter gasoline
Two videos, which are publicly free available from was poured down into a 30cm×30cm oil box. A laboratory
http://signal.ee.bilkent.edu.tr/VisiFire/Demo/SampleClips. assistant ignited the oil and then he left the scene quickly.
html, were used to test the system. As shown in Fig. 12a, About 6 s later, the fire detection module raised a fire alarm
it is a non-smoke video of car lights, and no alarm is trig- and at the same time it controlled the fire suppression mod-
gered. As shown in Fig. 12b, the system can detect smoke in ule to automatically extinguish the gasoline fire, as shown in
a video in a short time. Fig. 15.
Figure 13 gives a snapshot of software interface of the
integrated system which includes video fire detection and
automatic control of fire suppression. 5 Conclusions
As shown in Fig. 14, we performed an on-line experiment
of fire detection and automatic fire suppression in a large We have presented an integrated system based on video
space hall. First, our integrated software started to monitor surveillance for automatically detecting and extinguishing
123
948 F. Yuan
fire. The system is mainly composed of two modules 12. Yuan, F., Guangxuan, L., WeiCheng, F., Heqin, Z.: Vision based
which are responsible for fire detection and fire suppression, fire detection using mixture Gaussian model. In: The 8th Interna-
tional Symposium on Fire Safety Science 2005, 18–22 September
respectively. The former module makes full uses of tra- 2005, Beijing, China
ditional widely available CCD cameras. Computer vision 13. Aird, B., Brown, A.: Detection and alarming of the early appearance
techniques are adopted to extract color and motion character- of fire using CCTV cameras. In: Nuclear Engineering International
istics for real-time fire detection. Our fire detection algorithm Fire and Safety conference, 24–26 February 1997, London
14. Cappellini, V., Mattii, L., Mecocci, A.: An intelligent system for
is capable of detecting fire as long as it is visible. When the automatic fire detection in forests. University of Florence, Italy
module finds a fire, the system will control the fire suppres- 15. Vicente, J., Guillemant, P.: An image processing technique for
sion module to automatically suppress fire. The fire suppres- automatically detecting forest fire. Int. J. Therm. Sci. 4, 1113–
sion module is composed of control device, mobile device, 1120 (2002)
16. Wieser, D., Brupbacher, T.: Smoke detection in tunnels using video
and water gun. On-line experiments performed in a large images. In: Proceedings of the 12th International confenrence on
space hall show that the integrated system can detect fire in Automatic Fire Detection, 25–28 March 2001, MD, USA
about a few of seconds after the fire was ignited and the fire 17. Foo, S.Y.: A rule-based machine vision system for fire detec-
was suppressed rapidly. tion in aircraft dry bays and engine compartments. Knowl. Based
Syst. 9, 531–540 (1996)
18. Ugur Toreyin, B., Dedeoglu, Y., Cetin, A.E.: Contour based smoke
Acknowledgements This project was supported by Foundation of
detection in video using wavelets. In: 14th European Signal Pro-
Education Department of Jiangxi province (GJJ09297) and Natural
cessing Conference EUSIPCO 2006, Florance, Italy
Science Foundation of Jiangxi Province (2007GQS0076). Special
19. Guillemant, P., Vicente, J.: Real-time identification of smoke
thanks are given to Professor Zhang Yongmin of the State Key Lab
images by clustering motions on a fractal curve with a temporal
of Fire Science and anonymous reviewers for their helpful suggestions.
embedding method. Opt. Eng. 40(4), 554–563 (2001)
20. Ferrari, R.J., Zhang, H., Kube, C.R.: Real-time detection of steam
in video images. Pattern Recognit. 40-3, 1148–1159 (2007)
21. Gottuk, D.T., Lynch, J.A., Rose-Pehrssonb, S.L., Owrutskyband,
References J.C., Williams, F.W.: Video image fire detection for shipboard
use. Fire Saf. J. 41-4, 321–326 (2006)
1. Chen, T.-H., Kao, C.-L., Chang, S.-M.: An intelligent real-time fire- 22. Xiong, Z., Caballero, R., Wang, H., Finn, A., Lelic, M.A., Peng,
detection method based on video processing. In: IEEE 37th Annual P.: Video-based smoke detection: possibilities, techniques, and
2003 International Carnahan Conference on Security Technology, challenges. In: IFPA, Fire Suppression and Detection Research
14–16 October 2003, pp. 104–111 and Applications: A Technical Working Conference (SUPDET),
2. Pavlidis, I., Morellas, V., Tsiamyrtzis, P. et al.: Urban surveillance Orlando, FL (2007)
systems: from the laboratory to the commercial world. Proc IEEE. 23. Toreyin, B.U., Cetin, A.E.: Wildfire detection using LMS based
89(10), 1478–1497 (2001) active learning. In: Proceedings of the IEEE International Confer-
3. Stauffer, C., Grimson, W.E.L.: Learning patterns of activity using ence on Acoustics, Speech and Signal Processing (ICASSP)(2009)
real-time tracking. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 24. Yuan, F.: Motion accumulation and translucence based video
747–757 (2000) smoke detection model. J. Data Acquis. Process. 22(4), 396–400
4. Kim, J., Park, J., Lee, K., et al.: A portable surveillance camera (2007)
architecture using one-bit motion detection. IEEE Trans. Consumer 25. Yuan, F.: A fast accumulative motion orientation model based
Electron. 53(4), 1254–1259 (2007) on integral image for video smoke detection. Pattern Recogni.
5. Yamagishi, H., Yamaguchi, J.: Fire flame detection algorithm using Lett. 29(7), 925–932 (2008)
a color camera, 1999. MHS ‘99. In: Proceedings of 1999 Inter- 26. Granta, G., Brentonb, J., Drysdalec, D.: Fire suppression by water
national Symposium on Micromechatronics and Human Science, sprays. Prog. Energy Combust. Sci. 26, 79–130 (2000)
23–26 November 1999, pp. 255–260 27. McBride, Will E.: Fine water mist fire protection system. In:
6. Noda, S., Ueda, K.: Fire detection in tunnels using an image pro- 48th Annual Petroleum and Chemical Industry Conference (PCIC
cessing method. In: Proceedings of Vehicle Navigation and Infor- 2001), Toronto, ON, 24–26 September 2001, pp. 245–252
mation Systems Conference, 31 August-2 September 1994, pp. 28. Chen, T., Yuan, H., Su, G. et al.: An automatic fire searching and
57–62 suppression system for large spaces. Fire Saf. J. 39, 297–307 (2004)
7. Phillips III, W., Shah, M., da Vitoria Lobo, N.: Flame recognition 29. Chen, T.H., Yin, Y.H., Huang, S.F. et al.: The smoke detection
in video. In: Fifth IEEE Workshop on Applications of Computer for early fire-alarming system base on video processing. In: Pro-
Vision, 4–6 December 2000, pp. 224–229 ceedings of the 2006 International Conference on Intelligent Infor-
8. Ugur Toreyin, B., Dedeoglu, Y. et al.: Computer vision based mation Hiding and Multimedia Signal Processing, Pasadena, CA,
method for real-time fire and flame detection. Pattern Recognit. USA, 18–20 December 2006, pp. 427–430
Lett. 27(1), 49–58 30. Aggarwal, J.K., Nandhahumar, N.: On the computation of motion
9. Healey, G., Slater, D., Lin, T., Drda, B., Goedeke, A.D.: A system from sequences of images-a review. In: Proceedings of the IEEE,
for real-time fire detection. In: CVPR 1993, pp 15–17 (1993) pp 917–935 (1998)
10. Ugur Toreyin, B., Cinbis, R.G., Dedeoglu, Y., Cetin, A.E.: Fire 31. Viola, P., Robust M. Jones.: Real time object detection. IEEE
detection in infrared video using wavelet analysis. Opt. Eng. 46(6), ICCV Workshop Statistical and Computational Theories of vision,
067204-1–067204-9 (2007) Vancouver, Canada (2001)
11. Ugur Toreyin, B., Dedeoglu, Y., Cetin, A.E.: Flame detection in 32. Lienhart, R., Kuranov, A., Pisarevsky, V.: Empirical Analysis of
video using hidden Markov models. In: IEEE Int. Conf. On Image Detection Cascades of Boosted Classifiers for Rapid Object Detec-
Proc., ICIP 2005, Genoa, Italy tion. Intel Corporation, Santa Clara, USA (2002)
123