Professional Documents
Culture Documents
Sensation and Perception Course
Sensation and Perception Course
Aims:
Perceiving Form and
- Tell you about why the perception of form and organisation is
Perceptual Organisation important.
- Marrʼs approach
luke.jones@manchester.ac.uk
- Gestalt approach to organisation including laws (for example,
Law of Prägnanz) & figure-ground decisions …
1 2
3 4
1
5 6
7 8
2
And remember the retina is curved!
9 10
So…
• Receptors are unevenly distributed
• Image is inverted, distorted and tiny and FLAT
• Compensate for eye movement, body movement and object
movement
• Uneven amount of cortex devoted to different parts of the visual
field
• Nothing visual about the cortical representation? Nothing square
about a square.
11 12
3
13 14
15 16
4
Computational Model
Rubikʼs Cube Example
• Computational theory
• What is the model trying to do? What are the processes for? What is the
goal?
• Scrambled Cube
• Cross Algorithm
17 18
19 20
5
Primal Sketch to 21/2D Sketch
21 22
3D representation
3D
Primal Sketch 2 1/2 D Sketch Representation
23 24
6
Importance of the Computational Approach
• An algorithm/rule/system is more likely to be understood by
(2) Gestalt approach
understanding the problem that has to be solved, rather than the
examining the mechanism (and hardware) in which it is embodied
• To understand perception (purely) by studying neurons is like trying • Gestalt psychology – the whole is greater (different) than
to understand bird flight by studying only feathers : function not the sum of its parts (Max Wertheimer, 1912).
form (AI argument)
• Top-Down Approach
25 26
27 28
7
29 30
Necker Cube
Multistability
31 32
8
The Gestalt School
Wolfgang Kohler
1887-1967
Series of Experiments on Kohler and Koffka by Wertheimer,
Max Wertheimer Kurt Koffka together they developed the Gestalt school
1880-1943 1886-1947 Series of influential publications in 1920’s
33 34
• Gestalt psychology – the whole is greater (different) than Ambiguity generally does not arise in the real world. Rather,
the sum of its parts (Max Wertheimer, 1912). we usually see a stable and organised world.
• Don’t see lines and figures but forms and shapes (Gestalt
means form/shape in German)
• Top-Down Approach
• Gestalt psychologists interested in how we group parts of For example, most people see a set of overlapping
a stimulus together and the way we separate figure from circles, rather than one circle touching two adjoining
ground….SEGREGATION and GROUPING shapes that have ‘bites’ taken out of them. Why?
35 36
9
• Argue that we see objects according to all their elements taken
together as a whole
37 38
39 40
10
2. Good continuation
41 42
43 44
11
3. Proximity
45 46
4. Connectedness
47 48
12
5. Closure
49 50
51 52
13
53 54
55 56
14
6. Common Fate Common Fate cont..
• Objects with same orientation are grouped together
Things that are moving in the same direction are grouped
together
57 58
7. Familiarity
Explanation or
description?
59 60
15
8: Invariance
CAPTCHA Test
MAJOR Problem in
Computer vision
• Completely Automated Public Turing test to tell Computer and
Humans Apart
61 62
63 64
16
Figure-Ground Segregation
8. Prägnanz – “Good Figure”
Rubin
65 66
Figure-Ground
67 68
17
Figure-Ground Segregation
- Properties that affect whether area seen as figure or ground are:
69 70
• Explanation of how some of their laws worked was wrong. • Their laws actually appear to be generally correct.
• Their laws provide a description of how things work rather • Percepts can be analysed into basic elements.
than an explanation.
• The whole is greater than the sum of its parts.
• Their laws are ill defined – Prägnanz – what is the simplest
and most stable shape?
• Context and experience effect perception
• Stating the obvious?
71 72
18
Bottom-Up versus Top-Down
-Bottom-Up
• Top-Down
Start from the bottom, considering physical stimuli • The perceiver builds (constructs) a cognitive understanding
being perceived and then work their way up to (perception) of a stimulus, using sensory information as the
higher-order cognitive processes (organizing foundation for the structure but also using other sources of
principles and concepts) information to build the perception
73 74
KEY CONCEPTS
75 76
19
Depth Perception
Dr Luke Jones
Luke.jones@manchester.ac.uk
Weblinks
https://www.youtube.com/watch?v
=DrzmvI6iMrE
https://freakonometrics.hypothese
s.org/18317
http://psych.hanover.edu/Krantz/M
otionParallax/MotionParallax.html
https://wifflegif.com/tags/302273-
wiggle-stereoscopy-gifs
https://giphy.com/explore/wiggle-
stereoscopy 2
3
4
Seeing a 3-D world
5
Strong Innate Element to Perception of Depth ? 6
Visual Cliff video
• http://www.youtube.com/watch?v=DrzmvI6iMrE
• From 53 sec
7
Cues to depth
(1) Oculomotor cues: cues that depend on our ability to sense the position
of our eyes and tension in our eye muscles.
(2) Pictorial cues (monocular cues): cues that can be depicted in a still
picture.
(4) Binocular disparity: a cue that depends on the fact that slightly
different images of a scene are formed on each eye.
8
1) Oculomotor Cues
DEMONSTRATION
Look at your finger as you hold it at arm’s length. Then slowly move
your finger towards your nose. Be aware of how, as your finger
moves closer, you feel your eyes looking inward and you feel
increasing tension inside your eyes.
10
(1) Oculomotor cues
Shape of lens and position of eyes are correlated with the distance
of the object we are observing. Only effective cues at distances
closer than 5 – 10 feet (Liebowitz, Shina & Hennessay, 1972).
11
The closer the object the greater the convergence
12
13
14
VEILED CHAMELEON (Chamaeleo calyptratus )
15
2) Pictorial Cues
Cues that can be depicted in a
still (2D) picture.
16
2) Pictorial Cues
• Pictorial Cues (also called monocular cues) do not require viewing with both eyes in order
to work
17
i) Overlap or Interposition or Occlusion
(i) Overlapl/Interposition
22
Perception of size and depth
perception
n An object can look the same size at different distances But:
retinal image size changes with distance
n Increase distance : decrease retinal image size
n Decrease distance : increase retinal image size
n The fact that an object can look the same size regardless of
changing retinal image size is referred to as size constancy
SIZE CONSTANCY
23
24
25
Emmert’s law
• Emmert's Law states that objects that generate retinal images of the same size
will look different in physical size if they appear to be located at different
distances.
• An object of constant size will project progressively smaller retinal images as its
distance from the observer increases.
• Similarly, if the retinal images of two different objects at different distances are
the same, the physical size of the object that's farther away must be larger
than the one that is closer.
26
(iii) Relative Height
•As objects get further away they get nearer the horizon
•IF the objects are below eye height the highest object
is furthest away
•If the objects are above eye height then the lowest object
•is further away
28
29
•If the objects are above eye height then the lowest object
is further away
30
•IF the objects are below eye height the highest object
is furthest away
31
(iv) Atmospheric Perspective
32
Also appear more blue as blue light
is scattered more by atmosphere
33
Used as major depth cue in computer games
34
(iv) Familiar Size
35
(v) Linear perspective
Lines that are parallel in the scene converge as
they get further away.
36
37
38
39
But remember the retina is curved!
40
41
(vi)Shading and shadow
Shadows within objects - Attached Shadows
The shading that results from depth within an object is a cue to depth i.e.
ATTACHED SHADOW. The meaning of shading is ambiguous. A depression
and an elevation of a surface will be shaded on one side. Telling the
difference relies on knowing the direction of the light source. We assume
that light comes from above.
42
Assume direction of lighting from above.
43
44
45
Detached Shadows
46
47
48
49
50
Texture gradient
53
(3) Movement-produced cues
(i ) Motion parallax
As an observer moves relative to a 3-D scene, nearby objects appear to
move rapidly whereas far objects appear to move slowly.
http://psych.hanover.edu/Krantz/MotionParallax/MotionParallax.html
54
1. Relative
direction
2. Amount
of motion
55
56
57
Motion Parallax
58
(3) Movement-produced cues
(ii) Deletion and Accretion
59
2. Accretion & Deletion
60
Deletion Accretion
61
Binocular Disparity
62
(4) Binocular disparity
• Cue depends on two eyes & fact that our eyes see the world from slightly
different positions determined by the distance between them.
63
(4) Binocular disparity
DEMONSTRATION
With only your right eye open hold one finger upright
about 6 inches in front of you. Then position a finger
from your other hand about 6 inches further back, so
that it is completely hidden by the front finger. Now
close your right eye and open your left one, and the rear
finger become visible. Since your left eye sees from a
different point of view, it has looked around your front
finger.
64
65
(4) Binocular disparity
66
Corresponding Retinal Points
Regions on the two retinae that would overlap if you slid one
retina on top of the other.
Regions on the two retinae that would not overlap if you slid
one retina on top of the other.
69
70
The red lines between the tree
and the retinas describe the
angle of convergence the eyes
make when the tree is imaged
on both foveae. The tree is
imaged on corresponding points
of the retina - there is no
disparity.
Because the eyes are fixated on
the tree, the policeman, has its
image falling on non-
corresponding points of the
retinas. That is to say its images
are binocular disparate.
71
(4) Binocular disparity
An object located between the policeman and the tree would be result
in less disparate images on the retina.
The amount of disparity tells us how far the policeman is from the tree.
72
Binocular Disparity
73
Hyperstereo
Telestereoscope
74
75
76
77
(4) Binocular disparity
Julesz (1964) demonstrated that the visual system can use disparity
information directly to generate a percept of depth.
79
80
81
82
83
Animated autostereogram
84
Colour Filters
Cube 85
Orthostereography
86
Shutter Glasses
87
Lenticular Displays/Printing
88
Parallax Barrier Technology
89
90
Virtual Reality
91
92
93
94
95
96
97
98
Motion
parallax
Occlusion
Cast Shadows
Size constancy
Depth Contrast
Disparity
, 96
Convergence
Aerial
1 10 100
http://freakonometrics.hypotheses.org/18317
https://www.youtube.com/watch?v=GFTgkibl7DU
http://vision.psych.umn.edu/users/kersten/kersten-
lab/demos/shadows.html
http://psych.hanover.edu/Krantz/MotionParallax/MotionP
arallax.html
http://wifflegif.com/tags/302273-wiggle-stereoscopy-gifs
100
Colour vision
Colour vision
2
(1) What is colour good for?
3
(1) What is colour good for?
4
• Also strong evolutionary force depending
on species
• Food identification
– Ripe fruit
– Correct leaves
– Harmless or harmful berries
– Poisonous or venomous animals
5
(1) What is colour good for?
6
7
WARNING
IMAGE OF SNAKE
ON NEXT SLIDE
8
9
10
Camouflage
11
Camouflage
12
Cephalopods: Octopuses,
Cuttlefish and Squid
Mather, J. A. (2011). Consciousness in cephalopods. Journal of Cosmology, 14.
13
14
What is colour?
17
18
19
• Different objects absorb and reflect
different wavelengths of light
20
Hue, intensity and saturation
• The phenomenon of colour is more complicated than
just wavelength judgement.
22
(2) Examples
23
24
(3) Theories of Colour Perception
Trichromatic Theory
25
Trichromatic Theory (Young-
Helmholtz)
27
Three types of Cones: S, M and L
S M L
Short: ~ 419 nm
Medium: ~ 531 nm
Long: ~ 558 nm
28
29
30
Tapetum lucidum
(tap-e-tum lucyd-um)
31
32
Pigments in the cones determine which wavelengths
they respond to best
33
Hang on a minute...
• From the cones light is encoded as electrical
signal
• http://www.michaelbach.de/ot/col_benham/index
.html
• http://www.youtube.com/watch?v=9_0Z4Bi3JQo
34
Is your Red the same as my
Red?
• Explanatory gap
• Example of pain
• Consider tastes in colour
• Consider differences in taste.
• https://www.youtube.com/watch?v=59YN8
_lg6-U
35
Retina: cone distribution
n There is a concentration of
cones in an area called the
fovea – a small pit in the retina
(edge to edge: retina 32mm,
fovea 1.5mm).
• Three forms of
dichromatism (colour
blindness)
A mixture of green
and red light produces
same perception of yellow colour as monochromatic
yellow light (metamersim)- we cant tell the difference 39
Afterimages
40
Only red and green cones can respond producing
Yellow. Blue cones/channel fatigued/adapted
41
42
43
And coloured afterimages
44
45
46
47
48
Opponent Process Theory
(Hering (1920), Hurvich-Jameson)
Hering noticed that when people are
presented with large number of colour
samples and asked to pick out those that are
pure (not a mix), then:
The pick a red a green and a blue (as
predicted by trichromatic theory)
But also Yellow!
Also cones and fatigue were not understood,
so it was unclear how trichromacy could
explain afterimages
49
So he proposed
50
Opponent Process Theory
(Hering, Hurvich-Jameson)
3 processes which are opponent in nature:
(i) Red-Green
(ii) Yellow-Blue
(iii) Black-White
51
52
Three types of Cones: S, M and L
S M L
Short: ~ 419 nm
Medium: ~ 531 nm
Long: ~ 558 nm
53
Support for Opponent Process
Theory
54
Colour context effect
55
56
57
58
59
Lightness constancy
Perceive the squares are different even though reflected amount of light is same
Lightness constancy
62
Blue and Black? Gold and
White?
63
64
Trichromacy versus opponent process
65
66
Colour Blindness
• First described by John Dalton in 1794
67
(4) Colour Blindness
68
(4) Colour Blindness
69
Anopia:
Dichromatism: Missing cones
(a) Protanopia: L-cone pigment missing:
1.3% M 0.02% F
70
Protanopes (L missing) see only 2,
Deuteranopes (M missing) see only 4
71
72
73
Anomilies
Anomalous Trichromatism
(a) Protoanomaly: L-cone pigment deficiency:
1.3% M 0.02% F
(need more ‘red’ in ‘red-green’ mixture to match
‘yellow’)
74
Note that colour blindness types supports both colour vision
theories.
75
Human Tetrachromats
• Some very rare humans (predominantly
female) have 4 pigment cone types
• Can detect variations in hue that we
normally can not.
76
Other animals
• Some birds and butterflies have 5
receptors….
• But…..
77
The Mantis Shrimp
79
Web Resources
• http://www.youtube.com/watch?v=59YN8_
lg6-U
• http://youtu.be/evQsOFQju08
• http://www.ted.com/tedtalks/tedtalksplayer.
cfm?key=r_dawkins 80
Camouflage various animals
• http://www.boredpanda.com/animal-
camouflage/
• Octopus
• http://www.youtube.com/watch?v=SCgtYWU
ybIE
• Benham top
• http://www.michaelbach.de/ot/col_benham
/index.html
• Tommy Edison:
https://www.youtube.com/watch?v=59YN8 81
Evolutionary Importance
n Probably evolved very early
n Movement = life
n Predators that can detect movement of prey more likely
Perceiving motion and events to catch it
n Prey that can detect movement of predators more likely
to survive
n Many animals have very poor depth, shape, colour
perception
n NONE lack the ability to perceive movement
Dr Luke Jones
(Gordon Wallis, 1942)
2
1 2
Functions of motion
Movements attracts our attention (wave) (active or passive) Motion and form perception
Movement of an object relative to an observer provides information about
object’s 3 D shape.
Do we need to be able to recognise an object in order to see
Movement provides information that helps segregate figure from ground it move?
and perceptual organisation (common fate)
Do we match edges and contours between successive
Movement breaks camouflage (freeze reflex) views of an object?
Movement provides information that enables us to actively interact with Is this how motion works?
environment. Ball games
3 4
3 4
1
Motion and form perception
5 6
5 6
7 8
7 8
2
Motion and form perception 5 Ways to make a spot of light move
(1) Real movement
The 'correspondence problem' highlighted by RDKs
suggest that motion detection is direct. (2) Apparent movement
9 10
9 10
11 12
11 12
3
Movement detectors
When an image
moves across the
retina, it stimulates a
series of receptors.
Excitation and
inhibition interact to
create a cell that
responds only to
movement from right
to left
13 14
13 14
15 16
15 16
4
17 18
17 18
19 20
19 20
5
n Detectors such as these have been found in insects and
frogs
n We have something similar
n Cells in cortex sensitive to different orientations, speed
and direction of movement
n Aperture problem means output of all detectors must be
integrated at some stage (Medial Temporal Area
n DEMO
21 22
21 22
- Perception of velocity
23 24
23 24
6
Threshold for movement detection 3 cm of travel, viewed from 30cm
25 26
25 26
Perception of Velocity
27 28
27 28
7
Perception of Velocity
Circle of left has to travel twice as fast to appear at same speed a circle on
29 the right 30
29 30
Circle of left has to travel twice as fast to appear at same speed a circle on Cat has to travel twice as fast to appear at same speed as mouse
the right 31 32
31 32
8
Movement detectors
Cannot explain movement perception when:
33 34
Motion perception
Need a mechanism that tells us whether retinal stimulation
results from movement of stimulus, movement of observer
or both:
35 36
35 36
9
n If there is a difference between muscle
movement command and movement of image
across the retina then we perceive movement
Helmholtz outflow theory
Convincing evidence from:
n E.g. when tracking car, eyes move but retinal 1. Afterimages move when we move our eyes (Eye muscle
signal remains stationary, therefore perceive movement signal no retinal movement).
movement of the car 2. The world moves when we passively wobble our eyes
(retinal movement, no eye muscle movement signal).
n When keeping eyes still and object moves across 3. Immobilizing eye-ball results in attempted eye- movement
we perceive movement leading to apparent movement of world in opposite
direction (Eye movement signal, no retinal movement).
n When we look around the world, eye movement ES = Eye movement signal
command and retinal image movement are equal RM = Retinal movement
so we perceive NO movement 37 38
37 38
39 40
39 40
10
41 42
41 42
43 44
11
45 46
45 46
47 48
47 48
12
Slow apparent motion can be ambiguous
49 50
49 50
51 52
51 52
13
(2) Apparent movement cont... (3) Induced movement
Distance between two lights also affects perception of
apparent movement
53 54
53 54
55 56
55 56
14
57 58
57 58
59 60
59 60
15
61 62
61 62
63 64
63 64
16
65 66
65 66
http://psychlab1.hanover.edu/Classes/Sensation/induced/
(3) Induced movement
Sitting on train – feel it move backward, only to realize that
your train is actually standing still, and the one next to you
is moving forward.
67 68
67 68
17
(4) Autokinetic movement (4) Autokinetic movement
- Sherif (1935)
Individually – dot moved from 0.8 – 7.4 inches
Group – all reported moved 4 inches
Autokinetic effect open to suggestion!
Turn out all room lights. When the surrounding
framework of the room is not visible, the small
- Control of eye muscle not completely stable in dark?
stationary light appears to move, usually in an erratic
Knowing where eyes are and how stable they are may be
path. difficult in dark.
- Foo-fighters
69 70
69 70
71 72
71 72
18
Ratio hypothesis Barlow & Hill (1963)
ON OFF
Hubel & Wiesel (1959) identified directionally specific motion Impulses
detectors. per second
Firing in preferred
direction cell
Sutherland (1961) argued that motion after-effects arose
from an imbalance in the ratio of activities from two sets of
directionally-tuned receptors, each sensitive to the Note fall off in
rate of firing Period of
opposite directions of motion. presumed
motion
Barlow & Hill (1963) provide direct evidence to support ratio Firing in null direction cell after-effect
hypothesis.
Time
73 74
73 74
Examples:
- Creating structure from motion
75 76
75 76
19
77
77
20