Professional Documents
Culture Documents
Aula - Signal Detection Theory
Aula - Signal Detection Theory
Aula - Signal Detection Theory
92.9%
1 2 3 4 5 6 7
1 2 3 4 5 6 7
3.8
3.1
2.5
1.8
1.1
0.4
-
2.8 3.45 1.45 1.45 2.29
Simple Threshold
0% 1.5% 2.9% 5.8% 11.6% 23.2% 46.5%
100%
75%
50%
25%
0% 0% 1.5% 2.9% 5.8% 11.6% 23.2% 46.5%
Simple Threshold
Psychometric Function
No Yes
0% 1.5% 2.9% 5.8% 11.6% 23.2% 46.5%
No Yes
0% 1.5% 2.9% 5.8% 11.6% 23.2% 46.5%
Objections to Simple Model
Smooth transition
Subliminal perception
Response bias
Signal detection theory
A model & a data analysis method for
decision problems with uncertainty (noise)
Originates from World
War II: aircraft detection
on radar signals
Today: widely used in
psychophysics, medicine,
radiology and
machine learning
Signal detection theory
Experiment setup:
A stimulus (signal) is presented or not;
Observer reports if she/he saw a signal or not
Calculate how many times the observer detected a signal
when it was presented (hit rate)
Is the hit rate all we want to know?
Two observers achieved the same hit rate. Are
they certainly behaving the same way?
NO, we also need to know how many times the
observer said “I see” when there was no signal (false
alarm rate)
Signal detection theory
Confusion matrix: contains all the information about the
observer’s performance
Signal detection theory
Confusion matrix: contains all the information about the
observer’s performance
As columns add up 40 trials
to 100%, it is enough
to know one item 20 = 100% 20 = 100%
from each column
6 = 30%
18 = 90%
14 = 70%
2 = 10%
Signal detection theory
Perfect detection:
100% 0%
0% 100%
Signal detection theory
No detection at all (1st example): always
reporting “Seen”
100% 100%
0% 0%
Signal detection theory
No detection (2nd example): always reporting
“Not seen”
0% 0%
100% 100%
Signal detection theory
No detection (3rd example): flipping a coin
50% 50%
50% 50%
Signal detection theory
No detection (4th example): reporting “Seen” in 30% of
the trials (no matter what is presented)
Rows equal
no detection
30% = 30%
70% = 70%
Signal detection theory
Receiver operating characteristic (ROC):
100%
hit rate
100%
hit rate
90% 30%
100%
Perfect detection
hit rate
100% 0%
100%
No detection:
always “yes”
hit rate
100% 100%
100%
No detection:
always “no”
hit rate
0% 0%
hit rate
50% 50%
No detection: 100%
reporting “yes” in
40% of the trials
hit rate
40% 40%
No detection: 100%
reporting “yes” in
30% of the trials
hit rate
30% 30%
No detection: 100%
reporting “yes” in
60% of the trials
hit rate
60% 60%
100%
Diagonal: no detection
hit rate
possible
sensation level
Signal detection theory
Sensation SL ≥ β YES
Signal level (SL)
present Sensation Decision
/absent NO
SL < β
100% 0%
0% 100%
sensation level
Signal detection theory
Sensation SL ≥ β YES
Signal level (SL)
present Sensation Decision
/absent NO
SL < β
perfect detection
is impossible
(if the two distributions
overlap)
sensation level online demo
Signal detection theory
Sensation level
Sensation level
http://www-psych.stanford.edu/~lera/psych115s/notes/signal/
Signal detection theory
hit rate
Sensation level
Sensation level
Signal detection theory
β=6
ROC β=6
curve β = 8
hit rate
β=8
β = 10
hit rate
(discriminability)
probability
sensation level
Signal detection theory
β (bias) can be informative about the decision
behavior:
Balanced: false alarm and
miss rates are equal
Liberal: the observer
says “yes” whenever balanced
there may be a signal
Conservative: liberal conservative
decision is yes only
when it is almost
certain that there is probability
a signal
sensation level
Signal detection theory
Discriminability:
how well the
observer can
separate the
presence of signal
from its absence
Measured by d’
(discriminability index,
also called sensitivity)
http://www-psych.stanford.edu/~lera/psych115s/notes/signal/
Signal detection theory
d’: selects the ROC curve
β: specifies a point on the selected
ROC curve
same information as hit rate &
false alarm rate, but:
hit rate, false alarm rate: β
both reflect sensation & decision
characteristics;
cannot separate the two
d’: depends only on sensation
β: depends only on decision
The two processes
are separated
http://psych.hanover.edu/JavaTest/Media/Chapter2/MedFig.ROC.html
Signal detection theory
How well is it detectable? How sensitive the observer is to the
stimulus?
Measured by d’
The higher d’ is, the more the stimulus is detectable
d’ = 0
not detectable at all
It is the difference between the means of the noise (N) and
the signal+noise (SN) distributions, divided by the standard
deviation of the noise (N).
d’ = [SN - N] / N
It can be estimated from the hit rate and the false
alarm rate.
Standardize hit & false alarm probabilities:
d’ = z( P(yes|SN) ) - z(P( yes|N) )
SDT Review
Perceptual decisions are made in the real world, which is full of
noise.
Perceptual responses are biased with respect to a criterion.
A criterion level can change based on the preference for
particular outcomes.
There is a trade-off between hit rate and false alarm rate.
Sensitivity/discriminability - the ability to discriminate a
stimulus from noise - it is independent of the criterion.
d’ is a measure of discriminability that is insensitive to the
criterion level.
d’ can be computed from the hit rate (proportion of stimuli
detected when present) and the false alarm rate (proportion of
stimuli reported when not present)
Supplementary
https://eupercebo.unb.br/2019/10/28/psicofisica-moderna-ii-
teoria-de-deteccao-de-sinal-parte-i/
https://eupercebo.unb.br/2019/10/28/psicofisica-moderna-ii-
teoria-de-deteccao-de-sinal-parte-ii/