Survey on Image

Inpainting
Methods
Mulukutla N V L Kashyap
ID:1366945

Contents
1.
2.
3.
4.
5.

What is Image Inpainting?

Methods Under Review
Methods Overview
Experimental Results
Conclusion

What is Image Inpainting?

Image Inpainting refers to the task of filling in the
missing or damaged regions of an image in an
undetectable manner.
Reconstruction of information in the missing or
damaged regions inside an image so that the
resulting image looks natural.
Goal: To fill the missing region with perceptually
plausible content using the information from rest
of the image.
Applications:

Image Coding
Lost block recovery
Scratch Removal
Removal of objects

Methods Under Review

Three methods:
Structure and Texture Inpainting
Decompose the image.
Structure Inpainting and Texture Inpainting are
performed.
The results are combined.

Multi-Resolution Image Inpainting

Construct Image Pyramid.
Inpaint low resolution image.
Consequently inpaint higher resolution images.

Visual Resolution Inpainting

Texture & Color Analysis

Structure & Texture

Inpainting
Image is decomposed into two functions:
f=u+v.
u: Image capturing the Basic Structure Component
v: Image capturing the Texture and Random Noise
Component

Use Structure Inpainting Algorithms on f1 to

obtain reconstructed Image.
Use Texture Synthesis Algorithms on f2.
Merge both the Structure Inpainted & Texture
Synthesized images.

Experimental Results
Structure & Texture Inpainting

Multi-Resolution
Inpainting
Build an Image Pyramid.
This is done by the method of down-sampling.

Choose a low resolution image and inpaint it.

Propagate this information to inpaint the higher
resolution image just above it in the pyramid.
We use a 3 x 3 patch on for inpainting the higher
resolution image.
We compute the Sum of Squared Difference values
for filling the unknown pixel values.

Experimental Results
Multi-Resolution Image Inpainting

Missing Block Completion

Specified Object Removal

Scratch Removal

Visual Inpainting
Two different perspectives:
Texture Analysis
Color Analysis

Use n-level wavelet transform to separate the

texturing image into different frequency
components.
We thus obtain multi-layer of the different
frequency composition of the texture image.
The repairing method must decide the initial level
of the repairing pixel.

Experimental Results
Image Inpainting based on human vision

Conclusion
Structure &
Texture
Inpainting

Multi- Resolution
Inpainting

Visual Resolution
Inpainting

This method
enables us to
simultaneously
recover texture and
geometric
information.

Lower
resolution
image in the image
pyramid
can
be
inpainted
with
faster speed.

Successfully resolve
high image vein
defections
which
simple color image
restoration methods
would be unable to
process.

Advantages of this
method include:
- better perceptual
quality
- faster speed
- Better
conformation to
the human vision.

Future
improvements
include
the
modification of color
components
of
image
using
wavelet
transformation
to
achieve
superior
image
inpainting

The key point is to

select a novel
combination of
Structure and
Texture Inpainting
Algorithms.

THANK YOU