Professional Documents
Culture Documents
GPU-based Rendering For Deformable Translucent Obj
GPU-based Rendering For Deformable Translucent Obj
net/publication/220067371
CITATIONS READS
20 687
5 authors, including:
Some of the authors of this publication are also working on these related projects:
Trajectory Analytics: A Free Software for Visually Exploring Urban Trajectories View project
All content following this page was uploaded by Yun Zeng on 02 June 2014.
Published online: 10 January 2008 Abstract In this paper we intro- scattering stage, we adopt two modes
© Springer-Verlag 2008 duce an approximate image-space for efficient accomplishment of the
approach for real-time rendering view-dependent scattering. Our
of deformable translucent models approach is implemented by fully
by flattening the geometry and exploiting the capabilities of graphics
lighting information of objects into processing units (GPUs). It achieves
textures to calculate multi-scattering visually plausible results and real-
in texture spaces. We decompose time frame rates for deformable
the process into two stages, called models on commodity desktop PCs.
the gathering and scattering cor-
responding to the computations Keywords Sub-surface scattering ·
Y. Gong · W. Chen (u) · L. Zhang · for incident and exident irradiance BSSRDF · Translucency · Real-time
Y. Zeng · Q. Peng respectively. We derive a simplified rendering
State Key Lab of CAD&CG, Zhejiang
University 310027, illumination model for the gathering
Hangzhou, China of the incident irradiance, which is
{ygong,chenwei,lzhang,yzeng,peng} amenable for deformable models
@cad.zju.edu.cn using two auxiliary textures. In the
1 Motivation like translucent objects are still not taking full advantage
of GPU power, especially the deformable ones.
Photo-realistic modeling and rendering have proven to be
capable of simulating the appearances of almost all types 1.1 Previous works
of objects, especially those with ideal diffuse, specular
or gloomy materials. Even for the objects with complex Translucency cannot be simulated by simply using re-
materials like skin, jade, marble and milk, there have flection or transparent illumination models because it is
been well-established techniques in the computer graph- formed by single and multiple scattering of the light.
ics community. Among them, one challenging task is the As a consequence, to accurately mimic a light trans-
simulation of translucent materials. Translucent objects port in a translucent object, time-consuming path sam-
are not fully transparent and allow light to transport and pling and many multi-integral computations are required.
diffuse directly through their interiors, making their ap- Traditional solutions include the finite element methods
pearances partially mellow and quite different from other [1, 19, 20], diffusion approximation [23], path tracing
materials. [6, 13], bidirectional path tracing [11] and photon map-
In the last few decades, the fast development of graph- ping [9].
ics hardware has left much room for the acceleration of To make it amenable for real-time processing, sample-
rendering algorithms. The release of shader model 3.0 and based rendering techniques are adopted. Hanrahan and
shader model 4.0 enable GPU to support more compli- his colleagues [6] used bidirectional reflectance distri-
cated functions in shaders. However, complex materials bution function (BRDF) for subsurface scattering, with
96 Y. Gong et al.
which the existing light is assumed to be emitted at the ured sub-scattering data. Xin Tong and his colleagues [25]
same point as the incident light on the surface of the ob- put forward a quasi-homogeneous material modeling and
ject. Later, Jensen and his colleagues [10] introduced the rendering method with a special-purposed sampling de-
dipole source method based on a more accurate bidirec- vice. Peers [18] introduced a compact representation of
tional subsurface reflectance distribution function (BSS- heterogeneous subsurface scattering functions. Donner
RDF) model, which consists of two parts, namely the and Jensen proposed a multi-layered model for light diffu-
exact single scattering and the multiple scattering. Al- sion in translucent materials [3], and applied it to human
though the dipole source method is only suitable for the skin simulation. They further introduced a spectral BSS-
case where the incident point and the existing point of the RDF model which considers not only subsurface but also
light are on a plane, applying it to an arbitrary surface can surface scattering [4].
still generate appealing results with appropriate restric-
tions on the discretization of the underlying surface [10]. 1.2 Our contributions
Jensen and his colleagues [8] further proposed an ac-
celeration technique by employing a hierarchical struc- Based on the investigations on the related literature, we
ture. Thereafter, many approaches have been introduced understand that there are still challenges for real-time ren-
for improving the performance by either pre-computing dering of deformable translucent objects. Most of exist-
and reusing the radiance or simplifying the illumination ing approaches suffer from either efficiency issues, such
model. as [22, 26] or lack of photo-realistic effects like [2, 12], in
Lensch and his colleagues proposed a texture atlas terms of deformable models.
aided algorithm [12] which preprocesses the handled This paper describes our efforts on boosting the per-
geometry to collect the impulse response of each surface formance and quality with a new approximate image-
point under subsurface scattering. It separates the response space approach. Our method adopts also BSSRDF model,
into local and global parts. The local response is mod- and mimics most kinds of light sources by integrating the
eled as a filter kernel stored in the textures and the global contributions from point lights, directional lights and the
response is calculated and stored in the vertices. It is ap- ambient lights. Conceptually, we decompose the compu-
parent that the requirement of costly preprocessing limits tation of translucency into two stages. In the first stage,
its application for deformable models. Recently, Hao and the radiances from all types of lights are collected over the
his colleagues [7] implemented a spherical harmonics- surfaces. We call this procedure the gathering of irradi-
based real-time rendering approach. Although visually ance. To facilitate its efficient computation at runtime, we
plausible results are achieved, it is likely to be fit for un- derive a simplified computational model that is especially
deformable models. A similar situation happen with the adoptable for the ambient lights. In addition, we employ
pre-computed radiance transfer (PRT) techniques [21, 26], an intermediate data sheet to store the gathered incident
as they follow the same pre-computation mechanism and irradiance.
demand too many memory consumptions. More recent On the other hand, in our approach the computation
work by Sloan and his colleagues [22] allows for local of outgoing irradiance under a given viewpoint is a sim-
deformations, though it is not sufficient for large and de- plified imitation of the light transport inside the objects.
formable models. We denote it as the scattering operation, where the color
By simplifying the illumination computation, inter- of each visible surface point depends on a variable num-
active rendering of deformable models is made possible ber of lightened source points. This makes the implemen-
at the expense of the loss of image quality. Mertens tation with current graphics hardware nontrivial because
and his colleagues [16] proposed a clustering-based al- the rendering pipeline is designed as amenable for gath-
gorithm that achieves interactive frame rates even for ering operations, where the destination of each pixel is
deformable models. They also proposed an importance defined before rasterization. With an attempt to convert the
sampling-based method, to consider only local scatter- scattering operations into a gathering procedure in GPUs,
ing [15]. Dachsbacher and Stamminger [2] introduced one may implement it at the fragment level. This scheme
an efficient two-phase image-space technique by using requires a great many texture lookups at the complexity of
a shadow map to store the irradiance from the light sources the image resolution. We overcome this inefficiency with
for latter scattering computation. Due to the limited accu- hierarchical sampling scheme.
racy of the sampling and filtering provided by the graphics In the rest of this paper, we first introduce a simplified
hardware, the results are not quite satisfactory. In addition, translucent illumination model based on a brief overview
the algorithm cannot simulate all-frequency lighting [26] of the BSSRDF model. We then present the gathering
because the shadow map is only feasible for point lights of irradiance in Sect. 3. Section 4 describes how to im-
and directional lights. plement the scattering process in programmable graph-
There are also some works on the simulation of inho- ics hardware. The experimental results are presented in
mogeneous materials. Goesele and his colleagues [5] pro- Sect. 5. Finally, we conclude the whole paper and high-
posed a so-called DISCO algorithm-based on the meas- light the future work in Sect. 6.
GPU-based rendering for deformable translucent objects 97
Here, αis the reduced albedo, σtr is the effective trans- where E j (x i ) is the incident irradiance of x i projected on
port coefficient, zr and z v are the distances from the dipole the basis ψ j .
98 Y. Gong et al.
3 The gathering of irradiance we use two auxiliary textures as described below. With
hardware-accelerated texture mapping technique, the irra-
With the simplified illumination model, we classify the diance from the shadow map and the cube map can be
light sources into two categories, namely the point or accumulated in the DSM in one rendering pass.
directional lights and the ambient lights. We employ an
intermediate sheet buffer to keep the diffused incident irra- 3.1 The point and directional lights
diance from all light sources, called diffusion source map
(DSM). Ideally, it should collect all possible E(x i ) for To determine the contributions from each point or direc-
each surface point. Although the representation of DSM tional light to the handled surface, we employ a shadow
is flexible, one fundamental requirement is that it should map for the storage of the irradiance in the visible sur-
facilitate fast neighbor searching and area estimation for face at the viewpoint of the light source. The shadow
subsequent scattering operations, which will be further map [27] is a commonly used technique in real-time ren-
mentioned in Sect. 4.2. Accordingly, we propose to gen- dering. Because we do not consider the decay of the light,
erate a equiareal parameterization [14, 24] of the handled this scheme amounts to add a constant value to the irra-
surface and keep multiple textures as DSMs. The search- diance map for each light source. Figure 3 illustrates the
ing of the neighboring regions can be accomplished by the usage of the shadow map in the accumulation of the irradi-
texture look-up operations in GPUs. ance from the point and directional lights.
For each element of DSM, we record the surface lo-
cation, the surface orientation and the sum of the inci- 3.2 The ambient lights
dent irradiance (Fig. 2). These attributes are to be used
in the scattering stage. To accumulate the contributions The second auxiliary texture is a spherical or cubical
from the point or directional lights and the ambient lights, environment map for storing the irradiance caused by the
Fig. 2a–d. Illustration of the DSM for the bunny model. a The bunny model; b The component for the surface location; c The component
for the surface orientation; d The component for the incident irradiance
GPU-based rendering for deformable translucent objects 99
Fig. 3. The DSM is determined by accumulating the contributions from the point or directional lights and the ambient lights at each surface
location
Fig. 7a,b. Our results for the Buddha model: a with one point light;
Fig. 6. The approximation of the irradiance response curve b with the point light and ambient lights
GPU-based rendering for deformable translucent objects 101
Fig. 8. Translucent rendering for teapot, bunny and Max Planck data sets with 1024 × 1024 image resolutions
References
1. Blasi, P., Saëc, B.L., Schlick, C.: A of ACM SIGGRAPH 2001, pp. 511–518 reflecting and translucent materials. ACM
rendering algorithm for discrete volume (2001) Trans. Graph. 9(1), 1–27 (1990)
density objects. Comput. Graph. Forum 11. Lafortune, E.P., Willems, Y.D.: Rendering 20. Sillion, F.X.: A unified hierarchical
12(3), 201–210 (1993) participating media with bidirectional path algorithm for global illumination with
2. Dachsbacher, C., Stamminger, M.: tracing. In: Proceedings of Eurographics scattering volumes and object clusters.
Translucent shadow map. In: Proceedings Rendering Workshop 1996, pp. 91–100 IEEE Trans. Vis. Comput. Graph. 1(3),
of Eurographics Symposium on Rendering (1996) 240–254 (1995)
2003, pp. 197–201 (2003) 12. Lensch, H., Goesele, M., Bekaert, P., 21. Sloan, P.P., Kautz, J., Snyder, J.:
3. Donner, C., Jensen, H.W.: Light diffusion Kautz, J.: Interactive rendering of Precomputed radiance transfer for real-time
in multi-layered translucent materials. In: translucent objects. In: Proceedings of rendering in dynamic, low-frequency
SIGGRAPH ’05: ACM SIGGRAPH 2005 Pacific Graphics 2002, pp. 214–224 lighting environments. In: Proceedings of
Papers, pp. 1032–1039 (2005) (2002) ACM SIGGRAPH 2002, pp. 527–536
4. Donner, C., Jensen, H.W.: A spectral bssrdf 13. Li, H., Pellacini, F., Torrance, K.: A hybird (2002)
for shading human skin. In: Proceedings of monte carlo method for accurate and 22. Sloan, P.P., Luna, B., Snyder, J.: Local,
Eurographics Symposium on Rendering efficient subsurface scattering. In: deformable precomputed radiance transfer.
2006 (2006) Proceedings of Eurographics Symposium ACM Trans. Graph. 24(3), 1216–1224
5. Goesele, M., Lensch, H., Lang, J., on Rendering 2005, pp. 283–290 (2005)
Fuchs, C., Seidel, H.P.: Disco: acquisition (2005) 23. Stam, J.: Multiple scattering as a diffusion
of translucent objects. ACM Trans. Graph. 14. Maillot, J., Yahia, H., Verroust, A.: process. In: Proceedings of Eurographics
23(3), 835–844 (2004) Interactive texture mapping. In: Rendering Workshop 1995, pp. 41–50
6. Hanrahan, P., Krueger, W.: Reflection from Proceedings of ACM SIGGRAPH 1993, (1995)
layered surfaces due to subsurface pp. 27–34 (1993) 24. Surazhsky, V., Gotsman, C.: Explicit
scattering. In: Proceedings of ACM 15. Mertens, T., Kautz, J., Bekaert, P., surface remeshing. In: SGP ’03:
SIGGRAPH 1993, pp. 165–174 Reeth, F.V., Seidel, H.P.: Efficient rendering Proceedings of the 2003
(1993) of local subsurface scattering. In: Pacific Eurographics/ACM SIGGRAPH
7. Hao, X., Varshney, A.: Real-time rendering Graphics 2003, pp. 51–58 (2003) symposium on Geometry processing,
of translucent meshes. ACM Trans. Graph. 16. Mertens, T., Kautz, J., Bekaert, P., pp. 20–30 (2003)
23(2), 120–142 (2004) Seidel, H.P., Reeth, F.V.: Interactive 25. Tong, X., Wang, J., Lin, S., Guo, B.,
8. Jensen, H.W., Buhler, J.: A rapid rendering of translucent deformable objects. Shum, H.Y.: Modeling and rendering of
hierarchical rendering technique for In: Proceedings of Eurographics Rendering quasi-homogeneous materials. In:
translucent materials. ACM Trans. Graph. Workshop 2003, pp. 130–140 (2003) Proceedings of ACM SIGGRAPH 2005,
21(3), 576–581 (2002) 17. NVIDIA: GPU programming guide (2007) pp. 1054–1061 (2005)
9. Jensen, H.W., Christensen, P.: Efficient 18. Peers, P., vom Berge, K., Matusik, W., 26. Wang, R., Tran, J., Luebke, D.:
simulation of light transport in scenes with Ramamoorthi, R., Lawrence, J., All-frequency interactive relighting of
participating media using photon maps. In: Rusinkiewicz, S., Dutré, P.: A compact translucent objects with single and multiple
Proceedings of ACM SIGGRAPH 1998, factored representation of heterogeneous scattering. ACM Trans. Graph. 24(3),
pp. 311–320 (1998) subsurface scattering. ACM Trans. Graph. 1202–1207 (2005)
10. Jensen, H.W., Marschner, S., Levoy, M., 25(3), 746–753 (2006) 27. Williams, L.: Casting curved shadows on
Hanrahan, P.: A practical model for 19. Rushmeier, H.E., Torrance, K.E.: Extending curved surfaces. In: Proceedings of ACM
subsurface light transport. In: Proceedings the radiosity method to include specularly SIGGRAPH 1978, pp. 270–274 (1978)
GPU-based rendering for deformable translucent objects 103
Y I G ONG received her bachelor’s degree from 2008 he is a visiting scholar at Purdue Univer- Brook University. He is interested in research
Shanghai Jiao Tong University in 2004 and her sity, USA. His current research interests include of image and video segmentation as well as
master’s degree from Zhejiang University in visualization and efficient modeling and photo- editing, GPGPU, computational complexity and
2006. Now she is a Ph.D. candidate of computer realistic rendering. optimization.
science at University of California, Santa Bar-
bara. Her research work is mainly focused on L ONG Z HANG is currently a Ph.D candidate Q UNSHENG P ENG is a professor of depart-
photo-realistic rendering and GPU algorithms. of the State Key Lab of CAD&CG, Zhejiang ment of applied mathematics and State Key
Besides these, she is also interested in image- University. He received his bachelor’s degree in Lab of CAD&CG at Zhejiang University since
based methods and computer vision. 2003 from the Department of Applied Math- 1988. He received his Ph.D degree from the
ematics at Zhejiang University. His research School of Computing studies of East Anglia
W EI C HEN is an associate professor in State interests include real-time rendering, visualiza- University, UK in 1983. His research interests
Key Lab of CAD&CG at Zhejiang University. tion and computer animation. include realistic image synthesis, virtual reality,
From June 2000 to June 2002, he was a joint infrared image synthesis, multi-spectral informa-
Ph.D student in Fraunhofer Institute for Graph- Y UN Z ENG got his master’s degree from Zhe- tion fusion, computer animation and scientific
ics, Darmstadt, Germany and received his Ph.D jiang University in 2006. Now he is a Ph.D visualization.
degree in July 2002. From June 2006 to June candidate of computer science at SUNY Stony