Academic Press

Library in Signal
Processing, Volume 6
Image and Video
Processing and Analysis
and Computer Vision
 Academic Press
Library in Signal
Processing, Volume 6
Image and Video
Processing and Analysis
and Computer Vision

Edited by
Rama Chellappa
Department of Electrical and Computer Engineering
and Center for Automation Research, University of
Maryland, College Park, MD, USA

Sergios Theodoridis
Department of Informatics & Telecommunications,
University of Athens, Greece
Academic Press is an imprint of Elsevier
125 London Wall, London EC2Y 5AS, United Kingdom
525 B Street, Suite 1800, San Diego, CA 92101-4495, United States
50 Hampshire Street, 5th Floor, Cambridge, MA 02139, United States
The Boulevard, Langford Lane, Kidlington, Oxford OX5 1GB, United Kingdom

# 2018 Elsevier Ltd. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or by any means, electronic
or mechanical, including photocopying, recording, or any information storage and retrieval system,
without permission in writing from the publisher. Details on how to seek permission, further
information about the Publisher’s permissions policies and our arrangements with organizations such as
the Copyright Clearance Center and the Copyright Licensing Agency, can be found at our website:
www.elsevier.com/permissions.
This book and the individual contributions contained in it are protected under copyright by the Publisher
(other than as may be noted herein).

Notices
Knowledge and best practice in this field are constantly changing. As new research and experience
broaden our understanding, changes in research methods, professional practices, or medical treatment may
become necessary.
Practitioners and researchers must always rely on their own experience and knowledge in evaluating
and using any information, methods, compounds, or experiments described herein. In using such
information or methods they should be mindful of their own safety and the safety of others, including
parties for whom they have a professional responsibility.
To the fullest extent of the law, neither the Publisher nor the authors, contributors, or editors, assume
any liability for any injury and/or damage to persons or property as a matter of products liability,
negligence or otherwise, or from any use or operation of any methods, products, instructions, or
ideas contained in the material herein.

Library of Congress Cataloging-in-Publication Data

A catalog record for this book is available from the Library of Congress

British Library Cataloguing-in-Publication Data

A catalogue record for this book is available from the British Library

ISBN 978-0-12-811889-4

For information on all Academic Press publications

visit our website at https://www.elsevier.com/books-and-journals

Publisher: Mara Conner

Acquisition Editor: Tim Pitts
Editorial Project Manager: Charlotte Kent
Production Project Manager: Sujatha Thirugnana Sambandam
Cover Designer: Mark Rogers
Typeset by SPi Global, India
Contents

C o n t ri b u t o rs ...................................... x.iii
About the Editors. ............................... xv

Section Editors ................................ XVII

In t ro du c t i o n ...................................... .............. ....... ...................................

xxi

SECTION 1 VISUAL INFORMATION PROCESSING

CHAPTER 1 Multiview Video: Acquis ition, P r o c e s s i ng ,
C om p re ss io n , and Virtual V i e w Rendering .. ............... 3
Olgierd Stankiewicz, G a u t h i e r Lafruit and Marek Domanski
1.1 MultiviewVideo............... ...................................... 3
1.1.1 Mul ti v i ew Video a n d 3D Graphic Representa ti on
Fonnats f o r VR....................... ...............................4
1.1.2 Super.Multiview Video f or 3D Light F i e l d D i s p l a y s . . . . . .. .. 5
1.1.3 DlBR S m o o t h View In t e rp o l a t i o n .. . ....................... 5
1.1.4 Basic P r i n c i p l e s o f DlBR ......... ............. ............................ 7
1.1.5 DIBR VS. Point Cl ou ds . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
1.1.6 DlBR, Multiview Video. and MPEG Standardization. . . . . . 12
1.2 MultiviewVideo Acq ui s ition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
1.2.1 Multiview Fu n da m en t a l s ........ .............................12
1.2.2 D ep t h in St ereo an d M ulti view Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
1.2.3 Multicamera Sy s t e m . . . . . . ..
... ....
. . . . . . . . . . . . . . . . . . . . ...... . . . . .. . ...
. . . . . . .
20
1.2.4 A c q u i s i t i o n Syste m Examples .. . . ....... ... . .. ...
....... ...... . . . . . . . . 23
..

1.3 MultiviewVideo P re p ro c es s i n g . . . . . . . . . . . . . . . . . . . . . . . . . . ............29

1.3.1 Geometrical Parameters..... ............. ....................... 29
1.3.2 Video C o rr ec t i o n ..
... . . . . .. .. .. ........... .............. .............. . . ...... . 35
1.4 D e p t h E s t i m a t i o n ... . . . . . ....... . ...................................3 8
1.4.1 Local St ereo M a t c h i n g . . . . . . ................... ........................... 39
1.4.2 Global St ereo Matching...... ..
........................ .41
1.4.3 M u l t i c a m e r a Dep t h E s t i m a t i o n . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44

1.5 View Sy n t h e s i s and Virtual N a v i g a t i o n . . . . . . .. . . . .48

1.5.1 Warping............................. .
. .................. .49
1.5.2 View B l e n d i n g . . ....... . . . .. . . . . . .................................... 51
1.5.3 Inpaiming .... . . . . ........ .
.... .
..... ...................... 52
1.5.4 View Sy n t h es i s Ref er e nce Software ................................. 53
1.6 Compression.. . .
... . . . . . ... . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . .... . . . . . . .. . . . . . . . .
. .. .
54
1.6.1 I n t r o d u c t i o n ..
.. . . ....... . . . . . .....
. .......
. . . . . .. . .
. ...
..... ....
.. .... .. . . .......
.
54

v
Thank you for using Wondershare PDF Converter Pro 4.1.0.

You can only convert up to 5 pages in the trial version.

To get the full version， please purchase the program here:

http://cbs.wondershare.com/go.php?pid=839&m=db