Scribd Logo
Upload

Welcome to Scribd!

  • Image-Based Visual Hulls

    Uploaded by

    Govind Sharma
    19 views64 pages
    This document proposes techniques for real-time acquisition and rendering of dynamic scenes using image-based visual hulls. It presents a view-dependent visual hull representation that can be efficiently computed from multiple images. An algorithm is described for incrementally rendering the visual hull along scanlines with coarse-to-fine sampling. Visibility is computed conservatively using a coverage mask approach. Together these allow compelling real-time visualization of textured visual hulls from multiple camera views. Future applications discussed include 3D teleconferencing, distributed computation, and mixed reality.

    Original Description:

    Original Title

    ibvh

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    PPT, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document proposes techniques for real-time acquisition and rendering of dynamic scenes using image-based visual hulls. It presents a view-dependent visual hull representation that can be efficiently computed from multiple images. An algorithm is described for incrementally rendering the visual hull along scanlines with coarse-to-fine sampling. Visibility is computed conservatively using a coverage mask approach. Together these allow compelling real-time visualization of textured visual hulls from multiple camera views. Future applications discussed include 3D teleconferencing, distributed computation, and mixed reality.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as ppt, pdf, or txt
    19 views64 pages

    Image-Based Visual Hulls

    Uploaded by

    Govind Sharma
    This document proposes techniques for real-time acquisition and rendering of dynamic scenes using image-based visual hulls. It presents a view-dependent visual hull representation that can be efficiently computed from multiple images. An algorithm is described for incrementally rendering the visual hull along scanlines with coarse-to-fine sampling. Visibility is computed conservatively using a coverage mask approach. Together these allow compelling real-time visualization of textured visual hulls from multiple camera views. Future applications discussed include 3D teleconferencing, distributed computation, and mixed reality.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as ppt, pdf, or txt
    of 64

    Image-Based Visual Hulls

    Wojciech Matusik Ramesh Raskar


    Chris Buehler University of North Carolina
    at Chapel Hill
    Leonard McMillan
    Massachusetts Institute of Technology
    Steven J. Gortler
    Laboratory for Computer Science Harvard University
    Motivation

    Real-time acquisition and rendering of dynamic scenes


    Previous Work

    • Virtualized Reality
    (Rander’97, Kanade’97, Narayanan’98)
    • Visual Hull
    (Laurentini’94)
    • Volume Carving
    (Potmesil’87, Szeliski’93, Seitz’97)
    • CSG Rendering
    (Goldfeather’86, Rappoport’97)
    • Image-Based Rendering
    (McMillan’95, Debevec’96, Debevec’98)
    Contributions

    • View-dependent image-based
    visual hull representation
    • Efficient algorithm for rendering the visual
    hull
    • Efficient algorithm computing visibility
    • A real-time system
    What is a Visual Hull?
    Why use a Visual Hull?

    • Can be computed robustly


    • Can be computed efficiently

    background background foreground


    +
    foreground

    - =
    Rendering Visual Hulls

    Reference 2
    Reference 1 Desired
    Build then Sample

    Reference 2
    Reference 1 Desired
    Build then Sample

    Reference 2
    Reference 1 Desired
    Build then Sample

    Reference 2
    Reference 1 Desired
    Build then Sample

    Reference 2
    Reference 1 Desired
    Build then Sample

    Reference 2
    Reference 1 Desired
    Sample Directly

    Reference 2
    Reference 1 Desired
    Sample Directly

    Reference 2
    Reference 1 Desired
    Sample Directly

    Reference 2
    Reference 1 Desired
    Sample Directly

    Reference 2
    Reference 1 Desired
    Sample Directly

    Reference 2
    Reference 1 Desired
    Sample Directly

    Reference 2
    Reference 1 Desired
    Sample Directly

    Reference 2
    Reference 1 Desired
    Sample Directly

    Reference 2
    Reference 1 Desired
    Image-Based Computation

    Reference 1

    Desired
    Reference 2
    Observation

    • Incremental computation along scanlines

    Desired

    Reference
    Binning

    • Sort silhouette edges into bins

    Epipole
    Binning

    • Sort silhouette edges into bins

    Epipole
    Binning

    • Sort silhouette edges into bins


    Bin 1

    Epipole
    Binning

    • Sort silhouette edges into bins


    Bin 1

    Bin 2
    Epipole
    Binning

    • Sort silhouette edges into bins


    Bin 1

    Bin 2
    Epipole

    Bin 3
    Binning

    • Sort silhouette edges into bins


    Bin 1

    Bin 2
    Epipole

    Bin 3

    Bin 4
    Binning

    • Sort silhouette edges into bins


    Bin 1

    Bin 2
    Epipole

    Bin 3

    Bin 4
    Bin 5
    Binning

    • Sort silhouette edges into bins


    Bin 1

    Bin 2
    Epipole

    Bin 3

    Bin 4
    Bin 5
    Scanning

    Bin 1

    Epipole
    Scanning

    Bin 2
    Epipole
    Scanning

    Bin 2
    Epipole
    Scanning

    Bin 2
    Epipole
    Scanning

    Epipole

    Bin 4
    Scanning

    Epipole

    Bin 5
    Coarse-to-Fine Sampling
    IBVH Results

    • Approximately constant computation per pixel


    per camera
    • Parallelizes
    • Consistent with
    input silhouettes
    Video of IBVH
    Shading Algorithm

    • A view-dependent strategy
    Visibility Algorithm
    Visibility in 2D

    Reference view Desired view


    Visibility in 2D

    Front-most Points

    Reference view Desired view


    Visibility in 2D

    Visible

    Reference view Desired view


    Visibility in 2D

    Coverage Mask

    Reference view Desired view


    Visibility in 2D

    Visible

    Coverage Mask

    Reference view Desired view


    Visibility in 2D

    Visible

    Coverage Mask

    Reference view Desired view


    Visibility in 2D

    Not Visible

    Coverage Mask

    Reference view Desired view


    Visibility in 2D

    Coverage Mask

    Reference view Desired view


    Visibility in 2D

    Visible

    Coverage Mask

    Reference view Desired view


    Visibility in 2D

    Coverage Mask

    Reference view Desired view


    Visibility in 2D

    Not Visible

    Coverage Mask

    Reference view Desired view


    Shaded Visual Hulls
    System

    Camera Camera Camera Camera


    Client Client Client Client

    Server
    (4x 500 Mhz)
    System

    Trigger Signal

    Camera Camera Camera Camera


    Client Client Client Client

    Server
    (4x 500 Mhz)
    System

    Camera Camera Camera Camera


    Client Client Client Client

    Server
    (4x 500 Mhz)
    System

    Camera Camera Camera Camera


    Client Client Client Client

    Compressed video

    Server
    (4x 500 Mhz)
    System

    Camera Camera Camera Camera


    Client Client Client Client

    Intersection
    Server
    (4x 500 Mhz)
    System

    Camera Camera Camera Camera


    Client Client Client Client

    Visibility
    Server
    (4x 500 Mhz)
    System

    Camera Camera Camera Camera


    Client Client Client Client

    Shading
    Server
    (4x 500 Mhz)
    More IBVH Results
    Future Work

    • 3D teleconferencing
    • Distributed computation
    • Virtual sets
    • Post-production camera effects
    • Mixed reality
    Summary

    • Visual hulls with texture can provide a


    compelling real-time visualizations
    • Visual hulls can be computed accurately and
    efficiently in image space
    • View dependent shading with conservative
    visibility
    Acknowledgements

    • DARPA ITO Grant F30602-971-0283


    • A generous grant from Intel Corporation
    • NSF Career Awards 9875859 & 9703399
    • Tom Buehler & Kari Anne Kjølass

    • Thanks to all members of the


    MIT Computer Graphics Group

    You might also like