Professional Documents
Culture Documents
(1985) Joint Spatialspatial-Frequency Representations For Image Processing
(1985) Joint Spatialspatial-Frequency Representations For Image Processing
SPIEDigitalLibrary.org/conference-proceedings-of-spie
Joint Spatial/spatial-frequency
Representations For Image
Processing
Abs t r ac t
Abstract
This
This paper
paper deals
deals with
with the issue of
the issue of conjoint
conjoint resolution
resolution as it pertains
as it pertains to
to joint
joint
spatial/spatial-frequency
spatial /spatial- frequencyrepresentations
representations such
such as
as the
the Difference
Difference of (DOG) and
of Gaussians (DOG) and
Gabor representations
Gabor representations as
as well
well as
as the
the Wigner
Wigner distribution.
distribution. We We define what the
define what the conjoint
conjoint
resolution
resolution of
of aa joint
joint representation is, how
representation is, how one
one could
could measure
measure it,
it, why
why one
one would
would wish
wish to
to use
use
representation that
a representation that maximizes
maximizes it,
it, and
and finally,
finally, how
how high-
high-conjoint resolution is
conjoint resolution is obtained,
obtained,
in practice,
in practice, by
by selecting joint image
selecting an appropriate joint image representation.
representation.
Introduction
Joint spatial/spatial-frequency
Joint spatial /spatial - frequency representations
representationshave
haveattracted
attracted the
the attention
attention ofof vision
vision
researchers ever since
researchers ever since Rodiekl
Rodiek 1 proposed,
proposed, inin 1965,
1965, that
that retinal
retinal ganglion cells havehave receptive
receptive
fields
fields composed
composed of the difference of
of the of two
two Gaussians.
Gaussians. This model for for the
the center
center-surround
-surround
organization of
organization of both
both retinal
retinal ganglion cells and
ganglion cells and Lateral
Lateral Geniculate cells has
Geniculate cells has persisted
persisted to
to
date, popularized
date, popularized greatly by
by David
David Marr
Marr who
who incorporated
incorporated the
the Difference
Difference ofof Gaussians
Gaussians (DOG)
(DOG)
representation into his
representation into for early
his theory for early visual
visual processing.2
processing. ^
It
It was
was later
later discovered
discovered that
that the
the socalled
socalled "simple
"simple cells"
cells" ofof the
the primary
primary visual
visual cortex
cortex
exhibit not
exhibit not only
only spatial
spatial and
and orientation tuning, as
orientation tuning, as had
had been known for
been known for many
many years, 3 but
years,3 but also
also
and phase
orientation and phase specific
specificspatial
spatial-frequency tuning. ^ Marcelja^
- frequency tuning.4 Marcelja5 has demonstrated thatthat
the
the tuning
tuning of
of these neurons is
these neurons is well
well accounted
accounted forfor by
by assuming
assuming that
that each
each cell
cell computes
computes aa
coefficient of
coefficient of the
the Gabor representation6,
representation 6 , aa linear,
linear, 44-D-D complex-valued
complex -valued joint
spatial/spatial-frequency
spatial /spatial - frequency representation
representationthat
thathas
hassince
since gained
gained aa strong
strong following inin the
the
field.
vision field.
Jacobson
Jacobson andand Wechsler 7 ' 8 subsequently hypothesized,
Wechsler7'8 hypothesized, inin 1982,
1982, that
that the
the socalled complex
socalled complex
cells of
cells the primary
of the primary visual
visual cortex serve to
cortex serve to encode
encode an
an approximation
approximation to the Wigner
to the Wigner
distribution (WD),
distribution (WD), aa bilinear
bilinear signal representation that
signal representation that has recently created
has recently created quite
quite aa stir
stir
in the
in the signal
signal processing community.
community. According
According toto Jacobson and Wechsler'
Jacobson and Wechsler's s model 8 , phase
model8, phase and
and
magnitude information
magnitude information atat the
the simple
simple cell stage is
cell stage is further
further processed
processed inin aa bilinear fashion to
bilinear fashion to
obtain aa 44-D
-D spatial/spatial-frequency
spatial /spatial- frequencyenergyenergyrepresentation
representationthat
that approximates
approximates the
the WD
WD and
and
hence exhibits
hence exhibits superior
superior conjoint resolution "relative
conjoint resolutioh ielative to that of
to that the Gabor
of the Gabor representation
representation
itself. (Experiments
(Experiments designed to to test
test the
the Jacobson
Jacobson/Wechsler
/Wechsler hypothesis
hypothesis will be be conducted
conducted
during the coming
during the coming year
year by
by Pollen,
Pollen, Gaska,
Gaska, and
and Jacobson
Jacobson at
at the
the University
University of of Massachusetts
Massachusetts
Medical School,
Medical School, Worcester, MA). MA) .
The
The DOG,
DOG, Gabor,
Gabor, and
and WD models forfor ganglion
ganglion and
and LGN,
LGN, simple,
simple, andand complex
complex neurons,
neurons,
respectively, have
respectively, in common
have in common that they each
that they involve the
each involve the computation
computation and and encoding
encoding of
of aa
representation. However,
conjoint representation. However, as as one
one progresses
progresses fromfrom retinal
retinal
ganglion+LGN+simple+complex,
ganglion +LGN +simple +complex, thethe
conjoint
conjointresolution
resolutionofofthe theencoding
encoding isis seen
seen to
to
progressively
progressively increase;
increase; successive
successive stages
stages of
of linear
linear processing
processing are are finally
finally capped
capped by
by aa
bilinear
bilinear transformation
transformation that
that yields
yields aa conjoint
conjoint energy
energy representation,
representation, of of relatively
relatively highest
highest
resolution, at
resolution, at the
the complex
complex cell
cell stage.
stage. We emphasize
empha~sTze that,
that, though
though the
the Jacobson
Jacobson/Wechsler
/Wechsler
model for simple>complex
model for simple +complexcellcellprocessing
processing does
does capture
capture many
many ofof the
the known
known tuning
tuning properties
properties ofof
complex cells,
cells, it
it is
is nevertheless
nevertheless only an hypothesis at this this time.
time. In
In fact, remains
fact, there remains
some
some controversy
controversy as to whether complex
as to complex cells
cells derive
derive their
their tuning
tuning properties
properties from
from (a)
(a)
simple>complex
sequential simple +complex cell
cell processing, (b) (b) via
via direct
direct transformation of ganglion
ganglion cell
cell
inputs,
inputs, or
or (c)
(c) by
by some
some combination
combination ofof these
these two
two alternatives (cf. (cf. 99 and 10 for
and 10 for differing
differing
viewpoints)
viewpoints)..
Benefits
Benefits _o
off _c_o nj_o ^n t representations
conjoint represent a t ions
Conjoint image
Conjoint image representations
representations are not only
are not only relevant
relevant for
for understanding biological vision.
understanding biological vision.
They
They are
are also
also of
of interest
interest toto engineers
engineers since
since they
they serve
serve to
to decouple
decouple image
image patterns
patterns that have
that have
common functional support
common functional (i.e., are
support regions (i.e., are superposed)
superposed) inin either
either the
the spatial
spatial or
or spatial
spatial--
domains. With
frequency domains. the improved
With the improved support
support separability
separability of
of conjoint representations,
representations, it it
becomes
becomes feasible
feasible to
to perform
perform matched
matched filtering
filtering inin difficult
difficult imaging
imaging situations
situations where
where poor
poor
clutter rejection
rejection has
has traditionally
traditionally been
been aa problem.
problem. One can also exploit the
One can the high
high pattern
pattern
separability of
separability of joint image representations
joint image representations to
to decouple
decouple multiplicative
multiplicative image
image components
components
(e.g., reflectance
(e.g., reflectance and illumination) by
and illumination) by transforming
transforming the
the log
log of
of the
the image
image function.11
function. 11
Finally,
Finally, one
one can
can maximize
maximize the
the benefit
benefit of
of joint
joint representations
representations by by coupling
coupling them
them with
with
SPIE/EVol.
SP Vol579
579 Intelligent
Intelligent Robots
Robots and
and Computer
Computer Vision
Vision (1985)
(1985)// 1111
LINEAR PPf(x,ú)
f Cx,TT) = 1Jf(X,ú)
|j f (?,"u) I2
|2
BILINEAR Pf(3t,u)
Pf(x,ú) = |j f (x;,"u) |
1
12 / SPIE Vol
/ SPIE Vol. 579
579 Intelligent
IntelligentRobots
Robots and
and Computer Vision (1985)
Vis/on (1985)
We have,
have, in
in effect, treated the
effect, treated the normalized
normalized jointjoint energy
energy representation,
representation, Pf(1,11),
pfCx",), as
as aa
probability distribution
distribution over
over the
the (1,ú)-
(5f, 3)-space
space.. The
The conjoint
conjoint resolutions
resolutions ofof two
two different
joint representations,
joint representations, say
say Jf(1)(1',ú)
Jf(D(5f,1u) and and Jf( 2 )(£,"u), computed
Jf(2)(1,1), from the
computed from the same
same signal
signal f(1),
fCx"),
can then be
can then be compared by
by computing
computing thethe corresponding
corresponding repentropies
repentropies H(Jf(
H(Jf(D) and H(Jf(2));
I)) and H(Jf( 2 ))/ the
the
representation with
representation with the
the lowest
lowest repentropy
repentropy has has the
the highest
highest conjoint
conjoint resolution
resolution since,
since, on on
average, its energy is
its is rera
TeTaTfvely
Eively more
more concentrated
concentrated irf~tight throughout the
in Eight clumps throughout the
(x,T?)-space.
(x,)-space. By By defining repentropy as
defining repentropy as the
the entropy
entropy of of aa "probability"
"probability" distribution,
distribution, oneone
obtains
obtains aa measure
measure of
of conjoint
conjoint resolution
resolution that that is
is appropriate
appropriate even
even for
for joint
joint representations
representations
of
of highly signals.
highly nonstationary signals.
Now that conjoint
Now that in the
conjoint resolution in the form
form of
of repentropy
repentropy has
has been
been defined,
defined, it
it should be
be
clear
clear that
that one
one wants to maximize it
wants to it in
in order
order to
to obtain
obtain optimal
optimal pattern
pattern separability.
separability.
^Given an arbitrary
Given an arbitrary N-
N-dimensional signal, f((c),
dimensional signal, f(l£), ^T
IT = = [x^, x 2 / . . . , X N ] , the
[xl,x2,...,xN], the WD, Jf ( w ) ("x,ti) of
WD, Jf(W)(z,t) of
f(x) is defined by:
f(x) is by:
JJf(W)(X,ú)
f (W)(t,ti) =/£(£+
= f f(R) + f)f*(3f-|)e-3(u-l) d^
--2)f*(x-2)e-j(111)d7zi (2)
(2)
== f/ rf(x,á)
r f (x,a) e-j(íÌá)dT
e-jC^W
where
rrf(X,a) = f(x ++ á)f*(x-a),
f (x.t) = |)f*(x-|), (3)
(3)
2 2
and
and ""*"*" denotes
denotes complex
complex conjugation.
conjugation. The WD has
The has a similar
similar definition in
in terms
terras of the
the
signal's transform F(~3)
signal's Fourier transform F(íZ)..
Jf(W)(X,ú) = 1 -
(27r)N
/j F<3
F(ú ++)F*(ú
|)F*(u -)eJ(C
- x)dt
(4)
= 1
N
(27T) IN
f
x
Rf(tú )eJ(()d(
(2ir)
where
Rf(C,u)
Rf U,u) == F(if
F(ú ++ -|)F*(lT
2)F*(u -- ).
\) .
2, £,
(5)
(5)
The
The WD has
has aa number
number of
of useful properties.13'17
properties. 13 ' 17 We mention here only that,
that, though
though the
the WD isis
aa real,
real, hence
hence phaseless,
phaseless, representation,
representation, it
it isis nonetheless reversible (within
nonetheless reversible (within aa minus sign).
sign).
Indeed, Fourier
Indeed, Fourier phase
phase information is exploited
information is exploited inin definition
definition (4)
(4) of
of the
the WD
WD to
to transform
transform thethe
Fourier function,
Fourier function, aa pure frequency representation,
pure frequency representation, into
into aa joint
joint representation
representation ofof xx and
and u.
u.
The
The strong
strong association
association between
between phase
phase and
and position
position information
information has
has been
been recognized
recognized for
for some
some
time. 22
time.22
Popularized by
Popularized by Marr
Marr22 in his theory for
in his processing, the
for early visual processing, difference of
the difference of
representation of
(DOG) representation
Gaussians (DOG) of aa 2 2-D image is
-D image dimensional bipolar (i.e.,
3-dimensional
is aa 3- and --
(i.e., ++ and
only) joint
values only) representation that
joint representation that does dependupon
notdepend
does not spatial-frequency
uponspatial orientation
- frequency orientation
(due to
(due use of
the use
to the of isotropic filters). With
isotropic filters). this qualification
With this qualification inin mind,
mind, the DOG
the DOG
nonetheless be
representation may nonetheless regarded as
be regarded -D joint
as aa 44-D joint representation value is
whose value
representation whose is
constant
constant along rings in the
rings in -D spatial
the 22-D spatial frequency domain. The
frequency domain. representation is,
The DOG representation is, of
obtained by
course, obtained
course, convolving the
by convolving the image filters of
with filters
image with various sizes,
of various sizes, where the shape
where the of
shape of
these filters is
these filters approximated as
is approximated the difference
as the difference of two 22-D
of two Gaussians of
-D symmetric Gaussians different
of different
spatial
spatial extents. Such filter has
Such a DOG filter therefore the
has therefore the general form:
general form:
a2(x12 +x22)
h(x1,x2) = Ae- - Be- b2(x12 + x22) (6)
(a)
(e) (b)
(b)
2-D 2 -D spatial-frequency
2-D spatial- frequency
space domain
2 -D space domain
domain
Fig. 11 Conjoint of DOG
Conjoint energy averaging of filters. The commonly textured
DOG filters. regions suggest
textured regions the
suggest the
4-D
4 volumeover
spatial /spatial- frequencyvolume
-D spatial/spatial-frequency the intrinsic conjoint
which the
over which energyofofa a2 2-D
conjoint energy -D
signal is
signal is averaged by two
averaged by filters used to
typical filters
two typical compute the
to compute representation.
DOG representation.
the DOG
It has
It shown that
has been shown square modulus
the square
that the finite-support
thefinite
modulus ofof the transform is
- support Fourier transform is
to the
equivalent to
equivalent the convolution between the respective
between the distributions of
Wigner distributions
respective Wigner of thethe^signal
signal andand
specifically, the
functions. 17 ' ^' ^ Specifically,
window functions.17'18,19 joint energy
the joint distribution, Pf(G)(1,í')
energy distribution, the
of the
Pf ( G ^ ("£, if) of
Gabor representation is
Gabor given by:
is given by:
pf(G)(x,u) = IJf(G)(x,u)I2
= 1
N Jf
Jf(W)(x '')J(x-x'
W) , -1311:191 )ddú' . (9)
(9)
(2r) 1
(2TT)
The joint
The corresponding to
distribution corresponding
energy distribution
joint energy Gabor representation
the Gabor
to the representation is therefore aa
is therefore
smoothed version of
smoothed version the WD with the
of the the convolution given by
kernel given
convolution kernel the WD,
by the WD, Jh(W)(x,ú), the
of the
3^^^ (%,~&) , of
Gaussian function. With the
Gaussian window function. representation of
Gabor representation
the Gabor non-trivial
of aa non -trivial signal, such
signal, such
smoothing of
smoothing its energy
of its be eliminated
never be
energy representation can never eliminated by an appropriate
by an choice for
appropriate choice for
h(x); the size
h(?) ; rather the Gaussian window
the Gaussian
size of the determines, via
window determines, via Jh(W) between
MIT) , aa tradeoff between
J^ w ) (x'r'u) ,
14 / SPIE
/ SPIE Vol
Vol. 579
579 Intelligent
IntelligentRobots
Robots and Computer Vision (1985)
and Computer (1985)
u .T
>
X X
Fig. 2.
Fig. 2. Support regions of
Support regions of the Gabor smoothing
the Gabor kernel JJh(W)(x,u)
smoothing kernel for (a)
n ( w )(x,u) for narrowband and
(a) narrowband and
(b) broadband analysis
(b) -D signal. Note
of aa 11-D
analysis of Note the tradeoff in
the tradeoff in spatial vs. frequency
vs. frequency
resolution.
Fig. 3
Fig. 3 depicts
depicts the regions of
support regions
the conjoint support the Gabor
of the filter functions
Gabor filter indicates,
and indicates,
functions and
the conjoint
therefore, the
therefore, conjoint smoothness of the Gabor
of the representation. This figure
energy representation.
Gabor energy should
figure should
he compared with Fig.
be Fig. 1, for the
1, for the DOG representation; note the
DOG representation; the considerable improvement
considerable improvement
afforded by
afforded by using representation, especially
using the Gabor representation, regards the
as regards
especially as spatial-frequency
thespatial- frequency
selectivity.
orientation selectivity.
(a) (b)
2 space domain
-D space
2-D domain 2 ~-D spatial- frequency
D spatial-frequency
domain
Fig. 33 Conjoint
Conjoint energy averaging of filters. The
Gabor filters.
of Gabor The commonly textured regions above
regions above
suggest the 44-D
suggest the spatial /spatial- frequencyvolume
-D spatial/spatial-frequency volumeover the intrinsic
whichthe
overwhich energy of
conjoint energy
intrinsic conjoint of
a 2-D signal isis averaged
2 -Dsignal each of
by each
averaged by typical filters
three typical
of three filters kused toto compute Gabor
the Gabor
compute the
representation. Note the tradeoff in
the tradeoff in spatial spatial-frequency
vs. spatial-
spatial vs. smoothing.
frequency smoothing.
composite pseudo
The composite
The di^stjribution
Wigner distribution
pseudo Wigner
Given an
Given an N-D signal, f(x),
N -D signal, corresponding composite
the corresponding
f(x), the Wigner distribution
pseudo Wigner
composite pseudo distribution
(CPWD),13
(CPWD), iJ is bilinear joint
2N -Dbilinear
is aa 2N-D energy representation
pseudo energy
joint pseudo that approximates the
representation that Wigner
the Wigner
function. Though
distribution function. the CPWD
Though the CPWD is smoothed WD,
to aa smoothed
equivalent to
is equivalent WD, the degree of
the degree of
smoothing along
smoothing space and
the space
along the respectively, can
dimensions, respectively,
frequency dimensions,
and frequency be independently
can be independently
established; is, the
that is,
established; that CPWD, like
the CPWD, the WD,
like the is immune
WD, is to the
immune to problem.
tradeoff problem.
the window tradeoff
an NN-D
Given an -D signal, f(x),
f(~x), we define its
we follows:
as follows:
CPWD as
its CPWD
(1) Compute
(1) Compute the complex-valued
the complex representation, Jf(
Gabor representation,
-valued Gabor G )(x,~u),
Jf(G)(x ú), (or other
any other
(or any
finite -support Fourier
finite-support transform) of
Fourier transform) the signal.
of the sufficiently large
Use a sufficiently
signal. Use h(x")
window h(x)
large window
SPIE Vol.579
SPIE Vol. 579 Intelligent Robots and
Intelligent Robots (1985)//
Vision(1985)
Computer Vision
and Computer 15
Jf(CPWD)(x,u) f (G>(;T,uú++|)J
Jf (CPWD) ( t,lT) == J/ JJf(G)(x f *< G >U,t-f)G(3-f)df.
2)Jf*(G)(x,u -2)G(ú-)dE. (12)
(12)
some spa_t,ial
for some
for spatial frequency domain window
frequency domain has corresponding
that has
G(ú) that
window G(u) corresponding inverse Fourier
inverse Fourier
transform g(x). that, if
g(x). Note that, G(vT) == a(ú),
if G(ú) ie.e, aa delta
S("u), ie.e, delta function in frequency, then
in frequency, then
Jf(( CPWD)
Jf CPWD) (?,-£) j f (G)(^,-u")j f *<
(,ú) == Jf(G)(x,ú)Jf G >(ir,u)
*(G)(x,u)
= 1Jf(G)(3,u) I2
== Pf (G) ( ?f tT),
Pf(G)(x,ú); 03)
(13)
i.e., one
i.e., merely obtains
one merely the energy representation
obtains the to the
corresponding to
representation corresponding Gabor
the Gabor
representation.
If one
If one instead uses windows,
instead uses G(u), of
windows, G(u), -infinitesimal support,
non-infinitesimal
of non then this
support, then leads to
this leads the
to the
of phase
exploitation of
exploitation in each
information in
phase information local NN-D
each local frequency function
-D frequency the Gabor
of the
function of Gabor
representation, with
representation, with the that improved
the result that resolution is
spatial resolution
improved spatial obtained.
is obtained.
fact it
In fact
In it can be shown
can be 13 that
shown13 the CPWD is
that the to the
related to
is related WD of
the WD signal as
the signal
of the follows:
as follows:
Jf(CPWD)(x,) =
"
1__
(27T) N
IJf(
Jf
,ú)Jh(X-,u-u)Jg(
x
X ' U Uh
x ^
x
x',0)dx'dú' . (14)
(2n)
In Fig^ 44 we
In Fig. depict the
we depicjt the support Jg ( w )(x,u),
Jh< w )(x,u), Jg(W)(xx,
support regions of Jh(W)(x,u), ), Jg
Jg(W)(x and
1 ,0) and
< w ) (x-xx',0)
Jh^ w ) (~x. r ~u) Jg( w ) (if-lc
Jh(W)(x,u)Jg(W)(x 1 , 0) for
-x',0) several choses
for several the windows h(x)
for the
choses Jpr h(3f) and G(u ) . it
and G(1). is apparent
It is
from eq.
from eq. (14) (14) and Fig. 44 that
and Fig. the window h(x)
that the establishes the
MX") establishes smoothness of
frequency smoothness
the frequency the
of the
relative to
CPWD relative
CPWD the true
to the WD, whereas
true WD, G(ú) quite
whereas G(u) independently determines
quite independently determines the the spatial
spatial
smoothing. In essence,
In essence, G(u) provides an
G(ú) provides extra degree
an extra of freedom
degree of freedom in in adjusting
adjusting the smoothness
the smoothness
of the CPWD that
of the that is is notnot available in the definition
in the definition of the Gabor
of the itself.
representation itself.
Gabor representation
Fig.
Fig. 5 indicates the
5 indicates when using
smoothing, when
the conjoint smoothing, the CPWD,
using the of the
CPWD, of intrinsic
signal's intrinsic
the signal's
joint
joint energy distribution. With the CPWD, the
the CPWD, smoothing can be reduced to
joint smoothing
the joint to an
arbitrary degree
arbitrary indicated in
as indicated
degree as the figure.
in the fig. 55 with
figure. Compare fig. with the figs. 11
corresponding figs.
the corresponding
and 3
and 3 for the DOG
for the and Gabor
DOG and energy representatives,
Gabor energy respectively, and
representatives, respectively, note the
and note improvement
the improvement
one progressively obtains when
progressively obtains going from
when going DOG+Gabor+CPWD.
fromDOG+Gabor ;CPWD.
Conclusions
It is evident
It is evident from the results we have
from the presented that
have presented the WD
that the and its
WD and such
approximations such
its approximations
as the
as CPWD, can
the CPWD, resolution than
conjoint resolution
can provide higher conjoint DOG and
the DOG
than the representations.
Gabor representations.
and Gabor
We
We suggest therefore that the
suggest therefore be used
CPWD be
the CPWD when high
used when separability is
pattern separability
high pattern desired. We
is desired.
suggest further,
suggest that for
further, that reasons of
for reasons computational efficiency
of computational efficiency and modularity, one
and modularity, derive
can derive
one can
sequential computation
the CPWD by using sequential
the of DOG+Gabor+CPWD.
computation of DOG->Gabor>CPWD. It is interesting
It is interesting to that,
note that,
to note
as indicated in
as indicated introduction, this
the introduction,
in the sequential processing
this sequential appears to
scheme appears
processing scheme be analogous
to be analogous
to the
to processing performed in
the processing the mammalian vision
in the system.
vision system.
Ac k n o w1e dg eme n t
Acknowledgement
This was supported
work was
This work supported in part by
in part by the National Science
the National under Grant
Foundation under
Science Foundation Grant
and by
ECS- 8310057, and
ECS-8310057, MEIS at
by MEIS the University of
at the Minnesota.
of Minnesota.
16 / /
16 SPIE
SPIEVol
Vol.579
579Intelligent
IntelligentRobots
Robotsand
andComputer
ComputerVision
Vision (1985)
(1985)
u u
x x
(c) (d)
u u
T
y 4
I/
F2,3
<-2,3
x x
KEY: 1
1 -r<*.">
- Jh(W)(x,u) 33 -- Jg (><,0)
J9W)(x,0)
2 -- J(W)(x,u) I (W)(>
4 -- ,1(W)(x,u) V)(x,0)
J(W)(x,0)
J^\x u) J h 0<,u) J^V
9
Fig. 4.
Fig. Support regions
4. Support (hatched) of
regions (hatched) of effective kernel Jft(
smoothing kernel
effective smoothing Jh(W)(x,u)Jg(W)(x,0) for
w )(x,u) Jg( w )(x, 0) for
computed at
CPWDs computed
CPWDs at four resolutions.
four different resolutions.
(a) low space,
(a) low low frequency resolution,
space, low high space,
(b) high
resolution, (b) space, low frequency resolution, (c)
frequency resolution, (c) high
space, high frequency resolution,
space, high (d) full
resolution, (d) full resolution of WD.
of WD.
(a)
X2
o Xl
space domain
2 -D space
2-D -D spatial-frequency
2-D
2 spatial- frequency
domain
Fig. 5. Conjoint
Fig. 5. Conjoint energy averaging of nonlinear filters
of nonlinear to compute
used to
filters used compute the CPWD. The
the CPWD.
commonly textured suggestthe
regions suggest
textured regions the4 4-D
-D spatial /spatial- frequency volume
spatial/spatial-frequency volume over which the
which the
intrinsic conjoint energy of
intrinsic of aa 22-D signal is
-D signal averaged by
is averaged four typical
by each of four nonlinear
typical nonlinear
filters used to compute the
filters used CPWD.
the CPWD.
SPIE Vol.
SPIE Vol 579 Intelligent Robots Computer Vision
Robots and Computer Vision(1985)
(1985)// 17
1. R.
1. R. W.W. Rodieck,
Rodieck, "Quantitative analysis of
"Quantitative analysis of cat ganglion cell
retinal ganglion
cat retinal response to
cell response visual
to visual
Vision Research
stimuli ", Vision
stimuli", Research 5, 583 -601 (1965).
5, 583-601
2. D.
2. D. Marr, processing of
"Early processing
Marr, "Early of visual information",
visual information Phil. j[E5Jl§.i
", .Phi^ Trans. Royal ^9_?.i^y London
Royal Society London
B275, 483-524
B275, 483 (1976) .
-524 (1976).
3. D. H.
3. H. Hubel and T.
Hubel and T. N.N. Wiesel, "Receptive fields,
Wiesel, "Receptive interaction and
binocular interaction
fields, binocular functional
and functional
architecture in in the cortex",
visual cortex
cat's visual
the cat's ", J. J^ysic^ 160,
J_^ Physiol. 106-154
160, 106 (1962).
-154 (1962).
4. L.
4. L. Maffei
Maffei and
and A. Fiorentini, "The
A. Fiorentini, cortex as
visual cortex
"The visual as aa spatial frequencyanalyzer
spatial frequency analyzer", ",
Research 13,
Vision Research 1255-1267
13, 1255 (1973).
-1267 (1973).
5. S.S. Marcelja,
Marcelja, "Mathematical description of
"Mathematical description of the responses of
the responses simplecells
of simple cells",", J. Opt.
J. Opt.
Soc. Am. 70,
Soc. 1297-1300
70, 1297 (1980).
-1300 (1980).
6.
5. D. Gabor,
D. "Theory of
Gabor, "Theory communication",
of communication J. I.E.E. 93,
", J.I.E.E. 429-459
93, 429 (1946).
-459 (1946).
7. L.L. D. Jacobson and
D. Jacobson and H. H. Wechsler,
Wechsler, "The distribution as
Wigner distribution
"The Wigner as aa tooltool for deriving an
for deriving an
representationofof2 2-D
invariant representation images",
-D images ", in in Proc
Proc. IEEE J^y:er_n
. IEEE Pattern Recognition and Image
a_nd Image
Conf ere nee, Las
Processing Conference,
Processing Las Vegas, Nevada, June
Vegas, Nevada, June 13 13-17 (1982).
-17 (1982).
87
8. Jacobson and
L. D. Jac"obson
L7~D~ and H. Wechsler, "A
H. Wechsler, paradigm for
new paradigm
"A new computational vision
for computational vision basd basd on on thethe
distribution",
Wigner distribution
Wigner ", TR, Dept. of
TR, Dept. of Elec. University of
Eng . , University
Elec. Eng., Minnesota, April
of Minnesota, (1982).
April (1982).
9. W. Singer, F.
W. Singer, F. Tretter and M. "Organization of
Cynader, "Organization
M. Cynader, striate cortex:
cat striate
of cat cortex: A
correlation of -field properties
receptive-field
of receptive properties with afferent afferent and connections",
efferent connections
and efferent ", J. J.
Neurophysiol. 38, 1080-1098
38, 1080 (1975).
-1098 (1975).
P.Lennie, "Parallel
10. P.Lennie, pathways: AA review
visual pathways:
"Parallel visual review", ", Vision j^se_arch 20,
Vision Research 561-594
20, 561 (1980).
-594 (1980).
11. L. L. D. Jacobson and
D. Jacobson and H. Wechsler, "Invariant
H. Wechsler, analogical imagé representation and
"Invariant analogfrcar~ima"ge"~representation and
recognition",
pattern recognition Pattern Recognition Letters
", Pattern Letters 2, 289-299
2, 289 -299 (1984).
12. C.
C. Braccini,
Braccini, G. Gamba~rdella and
G. Gambärdella ancT~G. SandTnT, "A
G. Sandiñi, "A signal approach to
theory approach
signal theory to the space
the space
and frequency
frequency variant
variant filtering performed by
filtering performed by the human visual
the human system",
visualsystem ", Signal 3,
P r o c e s s i n g 3,
Signal Processing
231 -240 (1981).
231-240
13. L.L. D. Jacobson and
D. Jacobson and H. H. Wechsler,
Wechsler, "A theory for
"A theory invariant object
for invariant recognition in
object recognition in thethe
rontoparallel plane
ffrontoparallel plane",", IEEE Trans. on PAMI 6,
on PAMI 325 -331 (1984).
6, 325-331
14. R. K.
14. Potter, G.
K. Potter, A. Kopp and
G. A. and H.H. C. Green, Visible Speech,
C." Green, Speech, D. D. Van Nostrn Co.,
Van Nostrn Co., Inc.,Inc.,
1947. (Republished by
(Republished by Dover Publications, Inc.,
Dover Publications, 1966).
Inc., 1966).
15. D.
15. D. Marr
Marr and E. "Theory of
Hildreth, "Theory
E. Hildreth, of edge detection",
edge detection ", MIT AI Memo. 518,
AI Memo. 518, (1979).
16. M.M. Porat and Y.
Porat and Y. Y. Zeevi, "The
Y. Zeevi, generalized Gabor
"The generalized scheme of
Gabor scheme of image representation in
image representation in
vision",", Technion
vision Institute of
Israel Institute
Technion Israel of Technology
Technology EE Pub. No.
EE Pub. 519, March (1985).
No. 519, (1985).
T.A.C.M. Claasen
17. T.A.C.M. Claasen andand W.W. F.F. G. Mecklenbrauker, "The
G. Mecklenbrauker, distribution: aa tool
Wigner distribution:
"The Wigner tool for for
time-frequency
(1980) .
(1980).
analysis, Parts
time- frequency signal analysis, III ", Philips J.
PartsI-I-III",
--
-
J. Res. 35, 217
Res._35, 217-250,
-250, 276 276-300,
-300, 372 372-289
-289
18. T.
18. T. A.A. C. Claasen and
M. Claasen
C. M. W. F.
and W. G. Mecklenbrauker, "On
F. G. time-frequency
the time-
"On the frequency
discrimination of distributions: Can they
of energy distributions: sharperthan
look sharper
they look Heisenberg?"
thanHeisenberg ? ",, in in jEEE
IEEE
Int.1. Conf.
Intl. ASSP, San
Conf. ASSP, California, March
Diego, California,
San Diego, March1919-21 (1984).
-21 (1984).
19. P.
19. features of
"Some features
Flandrin, "Some
P. Flandrin, time-frequency
of time representations of
-frequency representations of multicomponent
multicomponent
signals",
signals ", inin IEEE Intl. ^p_nf^_
IEEE Intl. Conf. ASSP, San Diego,
ASSJ?, San March 19
California, March
Diego, California, 19-21 (1984).
-21 (1984).
20. C.C. P.P. Janse and A.
Janse and A. J.J. MM. Kaiser,
Kaiser, "Time- frequency distributions
"Time-frequency distributions of loudspeakers: The
of loudspeakers:
application of
application of the distribution",
the Wigner distribution Journal oof
", Journal the AucHo
f the Audio Engineering 31, (1983).
Soc . 31,
E n g i n e e r i n g Soc.
21. L. D.
L. Jacobson and
D. Jacobson and H. H. Wechsler,
Wechsler, "Deri t fo n~olT~op
" Del: TV aation of opEtTca 1 TTTo
cal flow w "~uusing spatiotemporal-
si n g~~aa spatiotemporal-
frequency approach",
frequency approach MEIS Technical
", MEIS Report #17,
Technical Report University of
#17, University Minnesota (1984).
of Minnesota
22. J.J. S. and A.
S. Lin and Oppenheim, "The
V. Oppenheim,
A. V. importance of
"The importance signals",
phase ininsignals
of phase Proc . IEEE
", Proc. IEEE 69, 69,
529-541
529 -541 (1981).
8 / SPIE
/18 Vol 579 Intelligent
SPIE Vol. Intelligent Robots and Computer Vision (1985)
Robots and