Download as pdf or txt
Download as pdf or txt
You are on page 1of 4

2019 IEEE 2nd International Conference on Information Systems and Computer Aided Education (ICISCAE)

A New Tone Mapping Operator Based on Two-


layer Model
2019 2nd International Conference on Information Systems and Computer Aided Education (ICISCAE) 978-1-7281-3066-8/20/$31.00 ©2020 IEEE 10.1109/ICISCAE48440.2019.221593

Pei Wu1, a, Congliang Hu1, Nanhang Luo1, Li Tao1, Wei Zheng1,2


1
Second Institute for Wuhan Ship Development & Design, Wuhan, China
2
National Key LAB of Science and Technology on Steam Power System for NS
a
wupei210@163.com

Abstract—Tone mapping is a process of compressing high layer. The luminance layer mainly contains the luminance
dynamic range image data into low dynamic range data information of each point in the scene, while the contrast
according to specific rules, so that the image can be displayed layer mainly contains the contrast information of the local
on ordinary display devices. The specific rules are called tone area in the scene. In the remaining sections, the detail of the
mapping operators. Nowadays, the mainstream tone mapping proposed operator is described in Section II. The
operator can be divided into two kinds, the global operators experimental results are shown in Section III and the
and the local operators. This paper processes a new tone conclusion will be drawn in Section IV.
mapping operator based on two-layer model. Our operator
combines the characteristics of global operators and local
operators, and it can effectively compress the high dynamic II. ALGORITHM
range images with an excellent performance. We make I(x,y) denote the HDR image, L(x,y) denote
luminance the layer and C(x,y) denote the contrast layer.
Keywords—high dynamic range image, tone mapping
operator, image processing
A. Luminance Layer Acquisition
I. INTRODUCTION Firstly, S-function transformation operator is used to
compress the HDR image, so as to obtain the luminance
High Dynamic Range (HDR) Imaging technology has information of the image.
recently been diffusing in many fields: aerospace, medical
imaging, unmanned aerial vehicle, and more [1] [2] [3]. But S-transform operator is based on an S-function curve
most contemporary display devices submarine only low which is nonlinear and range from 0 to 1. Its mathematical
dynamic range (LDR) images. So there is a need to convert model can be expressed by Equation (1).
HDR images to LDR images before displaying them on
ordinary display devices.
s  1.0 / (1.0  e  x ) (1)
Tone mapping provides an effective solution to solve the
problem, which compress HDR image data down to a lower
dynamic range. The methods that perform tone mapping are In this algorithm, the average luminance value of pixels
called tone mapping operators (TMOs). is taken as the eigenvalue. It can be computed as Equation
(2).
Over the years, various TMOs have been proposed,
which can be distinguished into two categories: global tone
mapping operators and local tone mapping operators. Global 1
operators process all the pixels due to the same curve. The Lavg  exp(
N
 log(  Lw (x ,y )))
curve can be specified before image processing or set (2)
according to the specific content of the HDR image. This
kind of operator is unified, so the pixels which have the same Lw(x,y) is the original gray value of pixel (x,y) in the
gray value in the original HDR image will have the same HDR image. N is the total number of pixels. In order to
gray value after compressed. Common global operators are prevent possible negative infinite results in logarithmic
linear transformation operator [4], logarithmic computation, a small positive number  is added. In this
transformation operator [5], histogram-based compression paper,  is set to 0.001.
transformation operator [6], S-function transformation We map the luminance value according to the method
operator [7] and so on. Local operator process the pixels with
shown in Equation (1), the luminance layer L(x,y) can be
respect to the influence of their closer neighbor. This kind of
computed as Equation (3).
operator considers the effect of pixel position during
processing, so that pixels with the same gray value may have
different values after compressed. Photographic tone [8] 1 log5(Lwa(x ,y )  1.0)
L(x ,y )  
bilateral filter method [9] and Retinex theory [10] are log10(Lwa _ max  1.0) 1.0  e  log5(Lwa (x ,y ))
commonly used methods of local operators. (3)

This paper presents a new TMO which combines the


global compression method with local compression. We
divide the HDR image into luminance layer and contrast

978-1-7281-3066-8/19/$31.00 ©2019 IEEE 86 September 28-30•2019 Dalian, China

Authorized licensed use limited to: Tsinghua University. Downloaded on October 20,2022 at 06:46:21 UTC from IEEE Xplore. Restrictions apply.
Where, Lwa is computed as Equation (4) and Lwa_max is if a pixel’s original value is low. It can significantly
computed as Equation (5). Lwmax is the maximum gray value improves the visibility of the image details in darker regions.
of the HDR image.
C. Operator Fusion
The final fusion operator can be obtained by combining
Lwa(x ,y )  Lw (x ,y ) / Lavg operator and, it can be computed as Equation (9).
(4)

Ld (x ,y )  L(x ,y )  C(x ,y ) (9)


Lwa _ max  Lw max / Lavg
(5)
According to the definition of L, C and Ld, the value of Ld
B. Contrast Layer Acquisition ranges from 0 to 1. In order to match the display width of
LDR devices, we need to map the gray value. The final
The LDR image computed by S-function transformation display image D is computed as Equation (10).
operator can present all the information in the original scene,
but the contrast of the obtained image is not rich and the
image has a fuzzy feeling. Therefore we take the effect of Ld (x ,y )  Ld (x ,y )  (2n  1)
local contrast into account, and calculate the contrast layer (10)
information, so as to optimize the local details of the LDR
image. Where, n is the width of the display devices.
The proposed method can be formulated as Equation (6).
III. EXPERIMENTAL RESULTS
Lw  x ,y  / Lavg In the experiment, we select a LED light source as the
C  x ,y   bright target and a book in the dark field as the dark target.
  V  x ,y   Lw  x ,y  / Lavg By using the high dynamic range imaging system based on
(6)
DMD and applying high dynamic scene recovery algorithm,
the data of the HDR scene is acquired [11].
Where, V(x,y) represents the contrast correction
parameter and represents the weight of the parameter. We choose three popular tone mapping operator (the
V(x,y) is computed as Equation (7). logarithmic operator, S-function operator and the operator
proposed by Reinhard) to compare with the operator we
proposed. The results are shown in Fig 1. In this experiment,
 1 L  x ,y   ris set to 2 and is set to 1.1.
V  x ,y   exp    w 
 1.44
 L  x , y  
 (7)
According to the results, we can see that the LDR images
processed by global methods are fuzzy and their contrast are
not enough. The local method proposed by Reinhard can
give the processed image a good contrast, but the image is
We assume the radius of pixel’s adjacent region is r, and
saturated at the details of the filament. Our proposed method
the average gray value for the region is donated as L(x,y)
efficiently enhances the brightness and contrast of the scene.
which can be computed as Equation (8).
From the LDR image processed by our method, we can see
the details of the LED while clearly identifying the words on
1 r r the book. The overall effect of the image can satisfy the
L(x ,y ) 
(1  2r )2
  Lw(x  r ,y  r ) intuitive feeling of the human eye.
 
i r j r (8)
Yeganeh [12] has created an image database for
evaluation purpose, which can provide fair conditions for
The adjacent region of pixel (x,y) is adaptive. Its size will
comparing images generated by different tone mapping
affects the calculation of average value and then affect the
algorithms. We choose Drago’s TMO, logarithmic TMO,
calculation of contrast layer. The contrast will be sensitive to
Ward’s global TMO and Reinhard’s TMO to compare with
random noise if the size is too small, while the result will be
our proposed method. We apply the above operators to
meaningless if the size is too large.
compress Bottles and Oxford Church. The compressed
By observing the definition of parameter V , it can be results are shown in Fig 2 and. Fig 3. It can be seen that the
seen that its value is determined by the ratio of pixel’s gray global TMOs can effectively compress the region with high
value and the gray value of pixel’s adjacent region. We luminance value, so that its details can be clearly displayed.
donate the ratio as . When pixel’s gray value is equal to the But it cannot handle the details of the dark regions well. The
gray value of its adjacent region, that is, the value of  is 1, local TMOs improve the shortcomings of global TMOs, but
V will become 0.5. With the increase of , V will gradually there is slight saturation in the bright regions and the
approach to 0, on the contrary, V will gradually approach to 1 processed images are blurred. Our proposed method absorbs
with the decrease of . the advantages of the above two kind of operators. The
compressed image is rich in color and the details of bright
According to Equation (6) and (7), after processing, the and dark regions can be displayed perfectly.
final pixel gray value will be further increased if it has a low
value. Through this method, the gray value can be enhanced Yeganeh has also proposed an objective quality
calculation method, called Tone Mapped image Quality

87

Authorized licensed use limited to: Tsinghua University. Downloaded on October 20,2022 at 06:46:21 UTC from IEEE Xplore. Restrictions apply.
Index. It can quantitatively analyze the performance of IV. CONCLUSION
different algorithms. Table I shows the results. It can be seen A new tone mapping operator based on two-layer model
that our method has the highest mean value. has been proposed. The operator is divided into luminance
layer operator and contrast layer operator. The luminance
TABLE I. TABLE STYLES layer operator compress the image in global and the contrast
TMO Mean TMQI
layer operator calculates the local contrast. By fusing the
Logarithmic TMO 0.6715 information of the two operators, we get our new operator.
Ward’s global TMO 0.6822 Experiments shows that our operator performs excellent. It
Reinhard’s TMO 0.8442 can boost the brightness and contrast in dark regions and
Drago’s TMO 0.8612 suppress the saturation in bright regions at the same time.
Our proposed TMO 0.8869

(a) logarithmic operator (b) S-function operator

(c) operator proposed by Drago (d) the operator we proposed

Fig. 1. The processed results

(a) Logarithmic TMO (b) Ward’s global TMO (c) Reinhard’s TMO

(d) Drago’s TMO (e) our proposed TMO


Fig. 2. The compressed results of Bottles

88

Authorized licensed use limited to: Tsinghua University. Downloaded on October 20,2022 at 06:46:21 UTC from IEEE Xplore. Restrictions apply.
(a) Logarithmic TMO (b) Ward’s global TMO (c) Reinhard’s TMO

(d) Drago’s TMO (e) our proposed TMO


Fig. 3. The compressed results of Oxford Church

[6] Larson G W, Rushmeier H, Piatko C. A visibility matching tone


ACKNOWLEDGMENT reproduction operator for high dynamic range scenes[J]. IEEE
Transactions on Visualization & Computer Graphics, 1997, 3(4):291-
This research is supported by the National Key R&D 306.
Program of China, marine nuclear power platform [7] Huang M, Huang H, Chan Z. An S-function based of tone
technology & equipment development and demonstration reproduction algorithm for digital photographic[J]. IEEE Transaction
application project (2017YFC0307800). on Visualization and Computer Graphics, 2003: 221-225.
[8] Reinhard E, Stark M, Shirley P, et al. Photographic tone reproduction
for digital images[J]. ACM transactions on graphics (TOG), 2002,
REFERENCES 21(3): 267-276.
[1] Bandoh Y, Qiu G, Okuda M, et al. Recent advances in high dynamic [9] Durand F, Dorsey J. Fast bilateral filtering for the display of high-
range imaging technology[C]//Image Processing (ICIP), 2010 17th dynamic-range images[C]. ACM transactions on graphics (TOG).
IEEE International Conference on. IEEE, 2010: 3125-3128. ACM, 2002, 21(3): 257-266.
[2] Zhang Y, Agrafiotis D, Bull D R. High Dynamic Range image & [10] Jobosn D J, Rahman Z, Woodell G A. A multiscale retinex for
video compression a review[C]. International Conference on Digital bridging the gap between color images and human observation of
Signal Processing. 2013:1-7. scenes. IEEE Transactions on Image Processing, 1997,6(7): 965-
[3] Reinhard E, Ward G, Pattanaik S, et al. High dynamic range imaging : 976.
acquisition, display, and image-based lighting[M]. Political parties [11] He Shu-wen, Wang Yan-jie, Sun Hong-hai, Zhang Lei,Wu Pei. High
and the state. Princeton University Press, 2006:2039 - 2042. dynamic range imaging based on DMD[J]. Acta Photonica Sinica,
[4] Ward, Greg. A contrast-based scalefactor for luminance display[J]. 2015, 44(8): 811001-0811001.
Graphics Gems, 1994:415–421. [12] Yeganeh H, Wang Z. Objective quality assessment of tone-mapped
[5] Drago F, Myszkowski K, Annen T, et al. Adaptive Logarithmic images [J]. Image Processing, IEEE Transactions on, 2013,22(2):
Mapping For Displaying High Contrast Scenes[J]. Computer 657-667.
Graphics Forum, 2003, 22(3):419–426.

89

Authorized licensed use limited to: Tsinghua University. Downloaded on October 20,2022 at 06:46:21 UTC from IEEE Xplore. Restrictions apply.

You might also like