Download as pdf or txt
Download as pdf or txt
You are on page 1of 48

(Original PDF) Signal Processing in

Auditory Neuroscience: Temporal and


Spatial
Visit to download the full and correct content document:
https://ebooksecure.com/download/original-pdf-signal-processing-in-auditory-neurosci
ence-temporal-and-spatial/
Five temporal factors as a function of time extracted from the running autocorrelation function (ACF) of a
continuous speech signal. The times of minimum value, (sε)min, observed are indicated by arrows. Relative sound
pressure level listening level; C: Wf(0); B: Pitch period s1; O: Pitch strength f1, and dashed line: development of
the pitch strength attaining Df1/Dt. “Ohayou gozaimasu,” single trail.
This page intentionally left blank
Signal Processing
in Auditory
Neuroscience
This page intentionally left blank
Signal Processing
in Auditory
Neuroscience
Temporal and Spatial Features
of Sound and Speech
YOICHI ANDO
Professor Emeritus
Kobe University
Kobe, Japan
3251 Riverport Lane
St. Louis, Missouri 63043

SIGNAL PROCESSING IN AUDITORY NEUROSCIENCE ISBN: 978-0-128-15938-5

Copyright Ó 2019 Elsevier, Inc. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or by any means, electronic or
mechanical, including photocopying, recording, or any information storage and retrieval system, without
permission in writing from the publisher. Details on how to seek permission, further information about
the Publisher’s permissions policies and our arrangements with organizations such as the Copyright
Clearance Center and the Copyright Licensing Agency, can be found at our website: www.elsevier.com/
permissions.

This book and the individual contributions contained in it are protected under copyright by the Publisher
(other than as may be noted herein).

Notices

Practitioners and researchers must always rely on their own experience and knowledge in evaluating
and using any information, methods, compounds or experiments described herein. Because of rapid
advances in the medical sciences, in particular, independent verification of diagnoses and drug
dosages should be made. To the fullest extent of the law, no responsibility is assumed by Elsevier,
authors, editors or contributors for any injury and/or damage to persons or property as a matter of
products liability, negligence or otherwise, or from any use or operation of any methods, products,
instructions, or ideas contained in the material herein.

Content Strategist: Melanie Tucker


Content Development Manager: Kathy Padilla
Content Development Specialist: Kristi Anderson
Publishing Services Manager: Deepthi Unni
Project Manager: Nadhiya Sekar
Designer: Gopalakrishnan Venkatraman

Printed in United States of America

Last digit is the print number: 9 8 7 6 5 4 3 2 1


Acknowledgments

The author would like to thank: Manfred Schroeder who joined a course for practice. The author’s response was
encouraged him to undertake a series of works since that he had just received the degree under Takeshi Itoh,
1970 including concert hall acoustics. M. Schroeder was Professor of Waseda University in 1975 and would not
Director of Drittes Physikalisches Institut, Georg- have time to perform his own study in parallel.
August-Univ. Goettingen and wrote a recommenda- The author would also like to extend his gratitude
tion letter to Alexander von Humboldt Foundation, toward Hans Werner Strube, who assisted the author
supporting the author to perform the investigations in with an initial investigation into speech recognition for
1975e77. The author would like to share a memorable about 3 weeks in 2011 and gave precise and precious
episode from a seminar at the institute when after a comments. Yoshiharu Soeta, who gave reprints of
presentation on subjective preference and the initial papers on evoked MEG for each factor extracted from
time delay gap between the direct sound and the first ACF/IACF. Marianne Jõgi, who improved English
reflection in relation to the effective duration (se) of usage.
ACF, Schroeder pointed out that the value of 1/s1 could Christa Trepte, a long-time friend, who provided
be the pitch (missing fundamental). This moment was room and board in summer of 2011 (Photo P1).
the very beginning of investigations into speech by the Ando, Y. Architectural Acoustics, Blending Sound
author. Later, Frau Edith Kuhfuss, Head of Secretaries Sources, Sound Fields, and Listeners. AIP Press/
called the author to her office and explained that the Springer-Verlag, New York (1998). In part with written
institute may offer a doctorate degree (in physics) if he permission of the publisher.

Photo P1 Crista Trepte (left) and the author (right) together with Keiko enjoyed tea in the garden on a summer day in 2011,
which was arranged by her husband Hainer Trepte during his life. We all became instant friends when we first met at Rohn-
sterrassen in 1975. Photographed by Keiko Ando.

vii
This page intentionally left blank
Preface

According to neural evidences and cerebral hemisphere width Wf(0) (spectral tilt), s1 (voice pitch period), f1
specialization related to subjective preference, we have (voice pitch strength), se (effective duration of the ACF
previously proposed a signal-processing model of the envelope, temporal repetitive continuity/contrast),
auditory brain system. Based on the model we have (se)min (segment duration), and Df1/Dt (the rate of pitch
thoroughly described primary percepts by autocorre- strength change, related to voice pitch attack-decay dy-
lation features as a basis for phonetic and syllabic namics). Times at which ACF effective duration se is
distinctions. These features have emerged from the minimal reflect rapid signal pattern changes that usefully
theory of subjective preference of the sound field that demarcate segmental boundaries. Results suggest that
was originally developed for architectural acoustics. vowels, CV syllables, and phrases can be distinguished on
Correlation-based auditory temporal features extracted the basis of this ACF-derived feature set, whose neural
from monaural autocorrelation are used to predict correlates lie in population-wide distributions of all-
perceptual attributes such as pitch, timbre, loudness, order interspike intervals in early auditory stations.
duration, and coloration of reflected sound. It is worth On the other hand, spatial factors extracted from the
noticing that, for example, the missing fundamental interaural cross-correlation function (IACF) represent
phenomenon derived from spectral analysis has for a the binaural listening level (LL; mainly binaural loud-
long time remained mysterious, whereas it is described ness), the amplitude of IACF: IACC (subjective diffuse-
by the factor s1 extracted from the running autocorre- ness), binaural time delay sIACC (localization in the
lation function (ACF) of source signals in very simple horizontal plane), and the width of IACC: WIACC
terms. (apparent source width, ASW). It is obvious that quality
This study investigates the use of features of monaural of musical sound in a concert hall and speech in a
ACFs for representing phonetic elements (vowels), syl- conference room can be comprehensively described by
lables (/ka/, /sa/, /ta/, /na/, /ha/, /ma/, /ya/, /ra/, /wa/ (CV these temporal and spatial factors. Every result obtained
pairs)), and phrases using a small set of temporal factors from these scientific procedures is always “simple and
extracted from the short-term running ACF. These factors beautiful” without any complicated mathematical
include listening level (loudness), zero-lag ACF peak calculation.

ix
This page intentionally left blank
Foreword

It has been more than 30 years since the publication of formulation of the relationship between the envelope
Yoichi Ando’s “Concert Hall Acoustics” (CHA). The of the autocorrelation function and the most preferable
current book describes Ando’s research since CHA was time delay of an early reflection.
published, taking a neuroscientific approach to human Decaying envelopes are familiar to acousticians in
preferences regarding sound. terms of reverberation, which is another dimension in
The book provides readers with an explanation of Ando’s four-dimensional space.
the present status of concert hall acoustics, which has Responses to a sound source can be formulated by
been well formulated via both physiological and psy- the convolution of the source waveform and the im-
chological research. Recent developments in the theo- pulse response from the source to the listening position
retical understanding of sound preferences can enable in the sound field.
new approaches to speech recognition and the design The impulse response yields the reverberation in
of hearing aids. the field as an almost exponentially decaying envelope
As described in Manfred Schroeder’s foreword in of its waveform.
the original version of CHA, much scientific research in The decaying property of the reverberation formu-
the 1970s and 1980s focused on improving the lates the signal dynamics of traveling sound in the
acoustics of concert halls from the perspective of space by convolution, such as the onset and offset
binaural hearing science. Based on this research, Ando portions, and ongoing envelopes.
developed the notion of the “four-dimensional world,” In contrast, the decaying envelope of the autocor-
which describes the most significant factors for concert relation function shows the duration or fluctuation of
hall acoustics in terms of preferences for transmitted the periodic properties of sound itself because purely
sound from a source to the listener’s ears. periodic signals are rarely encountered in daily life.
The four dimensions can be summarized as follows: Interestingly, the effective duration, which is when
the autocorrelation envelope of a sound decreases to
1. total sound energy, 0.1, referred to as “tau_e” in Ando’s terms, provides the
2. reverberation, most preferable delay time of an early reflection of the
3. delay time of early reflections, and sound.
4. spatial-binaural (interaural) cross-correlation. The sound-enhancing interference between direct
and reflected sound can be predicted under this crite-
These dimensions imply that the qualities of sound
rion, subject to the fusing of direct and reflected sounds
fields cannot be represented by a single number. Rather,
into a single sound image. Ando’s criterion for the most
sound dimensions can be understood from a subjective
preferred delay time of an initial reflection, which is
point of view, such as via listeners’ preferences.
formulated by the envelope of the autocorrelation
The most preferable delay time of early reflections
function, makes it possible to design an acoustic space
of sound depends on the properties of the sound
that is adapted to a particular purpose.
source, which can be expressed by the autocorrelation
Spatial correlations exhibit the periodic character-
functions of a signal.
istics of sound fields, regarding spatial coordinates
The autocorrelation function mechanism proposed
rather than the time domain. Sinc-functions of spatial
in the central auditory signal-processing model that
coordinates play an important role in spatial cross-
provides an estimate of the period of a signal. For
correlation functions, as well as those of the time
example, the fundamental frequency or pitch (the in-
domain for autocorrelation functions. The interaural
verse of the estimated period) is thus not necessarily
cross-correlation function of a pair of binaural sounds
contained in the spectrum of the signal itself. One of
perceived by a listener, defined in the spatial-time
the most interesting aspects of Ando’s work is the

xi
xii FOREWORD

domain, is a new dimension in concert hall acoustics The theoretical and experimental issues are well
proposed by Ando. Subjective diffuseness is a funda- organized, from introductory matters such as basic
mental notion representing listeners’ spatial and tem- terminology and a brief historical review, to explana-
poral impressions in response to sound fields where tions of recent research. As such, the book is accessible
the spatial correlation, in principle, follows the sinc- to a broad audience.
function. Ando’s preference theory focused concert hall
Interestingly, dissimilarity of the binaural sound acoustics research on the qualities of reverberation and
pair is necessary for preferable sound fields. The dif- sound fields, such as studies of delay time for early
ference in a pair of binaural signals cannot be perceived reflections and subjective diffuseness for reverberating
in monaural listening, and the dissimilarity is yielded sound fields.
by the time- or phase-difference between the binaural Sound is an informative phenomenon and is very
sound pair. much qualitative in nature.
The cross-correlation function is sensitive to such The theoretical understanding of the qualities of
differences, whereas the autocorrelation function is sound represents an important subject for sound-based
independent of the phase information of signals. communication, which is an important aspect of daily
Received sound waves can be represented by the life cross-culturally.
superposition of direct and reverberated sound. The The research into sound preferences examined in
energy ratio of direct sound followed by early re- this book involves an exploration of the science of
flections and reverberated sound is a conventional qualities, which is a significant issue for modern
parameter representing the sound field from a subjec- science.
tive point of view because the ratio is a function of the Readers will appreciate this well-written book, so
distance from the source and its directivity. that readers find appropriate theme for their future
In contrast, interaural correlations are determined project.
by the time-structures of binaural sound pairs, which
differs from the energy criterion. Mikio Tohyama
Ando developed the theory of acoustic space Fujisawa, Japan
design, including concert hall design, based on his own
neuroscientific research over the past 30 years. January 2018
Contents

1 Introduction, 1 Temporal Factors of the Sound Field, 27


Auditory Temporal and Spatial Factors, 1 Spatial Factors of the Sound Field, 28
Correlation Model for Temporal and Spatial Auditory Time Window for IACF Processing, 30
Information Processing, 2 Simulation of Sound Localization, 30
Theory of Subjective Preference for Sound Simulation of the Reverberant Sound Field, 31
Fields, 3 References, 34
Examples of Application, 3
References, 3 5 Magnetoencephalographic Evoked
Responses to Factors Extracted from
2 Human Hearing System, 5 the Autocorrelation Function (ACF)/the
Physical Systems of the Human Ear, 5 Inter-Aural Cross-Correlation
Head, Pinna, and External Auditory Canal, 5 Function (IACF) Factors, 35
Eardrum and Bone Chain, 5 Magnetoencephalographic Responses to Each
The Cochlea, 8 ACF Factor, 35
Auditory Brainstem Responses in Auditory Factor of the Sound Pressure Level, 35
Pathways, 8 Factors s1 and f1, 36
Auditory-Brainstem Response Recording and Factor se, 36
Flow of Neural Signals, 8 Meg Responses to IACF Factors, 38
Auditory-Brainstem Response Amplitudes in Factor Interaural Cross-Correlation, 38
Relation to Interaural Cross Correlation, 10 Factor sIACC, 38
Remarks, 13 References, 38
Central Auditory Signal Processing Model, 13 Suggested Reading, 38
References, 16
6 Neural Evidences Related to Subjective
3 Analysis of Sound Signals, 19 Preference, 39
Analysis of A Source Signal, 19 Slow Vertex Responses Related to Subjective
Autocorrelation Function of a Sound Signal, 19 Preference of Sound Fields, 39
Running Autocorrelation Function of a Source Neuronal Response Correlates to Changes
Signal, 19 in Dt1, 39
Vocal Source Signals, 20 Hemispheric Response Difference to Change
Recommended Auditory-Temporal Window, 21 in Listening Level and Interaural
Cross-correlation, 39
References, 25
Differences in Response Latency
Corresponding to Subjective Preference, 40
4 Formulation and Simulation of Sound Electroencephalographic and
Fields in an Enclosure, 27 Magnetoencephalographic Response
Sound Transmission from a Point Source to Ear Correlates of Subjective Preference, 43
Entrances in an Enclosure, 27 Electroencephalography in Response to
Orthogonal Factors of the Sound Field, 27 Change in Dt1, 43

xiii
xiv CONTENTS

Magnetoencephalography in Response to Preferred Delay Time of a Single


Change in Dt1, 44 Reflection, 67
Electroencephalography in Response to Preferred Horizontal Direction of a Single
Change in Tsub, 45 Reflection to a Listener, 69
Electroencephalography in Response Sound Fields with Early Reflections and
to Change in Interaural Subsequent Reverberation, 70
Cross-correlation, 47 Optimal Conditions Maximizing Subjective
Specialization of Cerebral Hemispheres for Preference, 70
Temporal and Spatial Factors, 49 Listening Level, 70
References, 49 Early Reflections After the Direct Sound
Suggested Reading, 50 (Dt1), 71
Subsequent Reverberation Time after Early
7 Temporal and Spatial Primary Percepts Reflections (Tsub), 71
of Sound and the Sound Field, 51 Magnitude of Interaural Cross-correlation
Temporal Primary Percepts in Relation to Function, 72
Temporal Factors of a Sound Signal, 51 Theory of Subjective Preference for the Sound
Pitch of Complex Tones, 51 Field, 72
Frequency Limits of the Autocorrelation Seat Selection Enhancing Individual Preference, 73
Function Model for Pitch Percept, 51 References, 79
Loudness of Sharply Filtered Noise Varying se
Within the Critical Band, 53 9 Temporal and Spatial Features of
Duration Sensation, 54 Speech Signals, 81
Timbre of an Electric Guitar Sound With Background, 81
Distortion, 54 Source Signals and Methods, 82
Concluding Remarks, 56 Single Vowels and Single Consonant-Vowel
Spatial Percepts in Relation to Spatial Factors of Syllables, 82
the Sound Field, 57 Single Vowels, 82
Localization of a Sound Source in the Single Consonant-Vowel Syllables, 84
Horizontal and Median Plane, 57 Vowel and Syllable Identification, 86
Cues of Localization in the Median Plane, 57 Continuous Speech, 87
Learning Effects on Monaural Localization in Background, 87
Normal Hearing Listeners, 58 Procedure, 88
Age Effects on Localization in Monaurally Results of Five Temporal Factors, 88
Impaired Listeners, 60 Conclusions, 95
Apparent Source Width for Normal Effects of Spatial Factors on Speech
Subjects, 63 Perception, 97
Subjective Diffuseness, 66 Future Directions, 100
References, 66 Automatic Speech Recognition, 100
Individual Preference of Significant Temporal
8 Subjective Preference of the Sound Factors for Hearing Aid, 100
Field, 67 References, 101
Sound Fields with a Single Reflection and Multiple
Reflections, 67 INDEX, 103
CHAPTER 1

Introduction

When designing enclosures (or any environment) for perception of diffuseness. Two years later, in 1974, a
spoken communication, the acoustic properties of comparative study of European concert halls performed
the sound field should be taken into account. This vol- by Schroeder, Gottlob, and Siebrasse, showed that the
ume describes the human hearing system and the IACC was the most important factor in the incipient
possible auditory mechanisms responsible for the rise subjective preference reactions that established a
of subjective preference. Because subjective preference consensus among individuals.
is a primitive response that steers the judgment and In early 1975 at Kobe University, we observed a su-
behavior of the organism in the direction of maintain- perior sound field with a speech signal that was
ing life, we investigated corresponding cerebral activity achieved when adjusting the horizontal direction and
in the slow vertex response (SVR) and brain waves in the delay time of a single reflection. A loudspeaker in
electroencephalogram (EEG) and magnetoencephalog- front of a single listener reproduced the direct sound.
raphy (MEG). The results suggest an auditory signal- The angle of the single reflection was about 30 degrees
processing model that yields primary percepts and a in the horizontal plane measured from the front, the
theory of subjective preference for the sound field.1-4 delay time was about 20 ms, and the amplitude was
The temporal and spatial primary percepts may be the same as that of the direct sound.6 These working hy-
well described by temporal factors extracted from the potheses were reconfirmed in the fall of 1975 while the
running autocorrelation function (ACF) and spatial fac- author was an Alexander-von-Humboldt Fellow in
tors extracted from the interaural cross-correlation func- Goettingen.7,8 We were also able to explain the percep-
tion (IACF), respectively. These mechanisms are the tion of coloration produced by the single reflection in
bases for automatic speech recognition and the design terms of the envelope of the ACF of the source signal.9
of hearing aids in the context of this volume. In 1983, a method of calculating subjective prefer-
ence at each seat in a concert hall was described by
four orthogonal factors of the sound field.10 Soon after,
AUDITORY TEMPORAL AND SPATIAL a concert hall design theory was formulated based on a
FACTORS model of the auditory system. We assumed that some
For the past five decades, we have pursued a theory of aspects depended on the auditory periphery (the ear),
architectural acoustics based on acoustics and auditory while others depended on processing in the auditory
theory. In the summer of 1971, I visited the III Physics central nervous system.11 The model takes into account
Institute at the University of Goettingen, where Manfred both temporal factors and spatial factors that determine
R. Schroeder encouraged me to investigate the aspects of the subjective preference for sound fields.1 The model
spatial hearing that are most relevant to the design of consists of a monaural ACF mechanism and an IACF
concert halls. Peter Damaske and I were, at that time, mechanism for binaural processing. These two repre-
interested in explaining the subjective diffuseness of sentations are used to describe monaural temporal
sound fields using the IACF. The maximum magnitude and binaural spatial hearing operations that we pre-
interaural cross-correlation (IACC) of this function is an sume to be taking place at several stations in the audi-
indication of the level of subjective diffuseness of a tory pathway, from the auditory brainstem to the
given sound field perceived by an individual due to hemispheres of the cerebral cortex.
binaural effects. We reproduced sounds in a room using Special attention was given to computing optimal
a multiple-loudspeaker reproduction system and individual preferences by adjusting the weighting coef-
recorded the signals at the two ears of a dummy ficients of four orthogonal factors (two temporal factors
head.5 Because the IACC was known to be an important and two spatial factors), which were used to determine
determinant in the horizontal localization of sounds, the most preferred seating position for each individual
we also believed it to be significant in subjective in the room.2 “Subjective preference” is important to

1
2 Signal Processing in Auditory Neuroscience

us for philosophical and aesthetic reasons as well as for In our laboratory, we have found neural correlates of
practical, architectural acoustics reasons. We consider spatial hearing in the left and right auditory brainstem
preference as the primitive response of a living creature responses (ABRs). Here, the maximum neural activity
that directs its judgment and behavior in the pursuit of (wave V) corresponds to IACC, that is, the magnitude
maintaining lifedof body, of mind, and of personal- of the IACF.24 Also, wave IV for the left and right side
ity.12 Thus, neural evidence obtained could be used to brainstem responses (IVl,r ) nearly corresponds to the
identify the auditory system’s signal-processing model. sound energies at the right- and left-ear entrances.
SVRs are averaged auditory-evoked responses computed
from scalp EEG signals. We carried out a series of exper-
CORRELATION MODEL FOR TEMPORAL iments aimed at developing correlations between brain
AND SPATIAL INFORMATION activity, measurable with the SVR and the EEG, and sub-
PROCESSING jective sound field preference. Subjective sound field
To develop a theory of temporal and spatial hearing for preference is well described by four orthogonal acoustic
room acoustics that is grounded in the human auditory factors, two temporal and two spatial. The two temporal
system, we attempted to learn how sounds are repre- factors are (1) the initial time delay gap between the
sented and processed in the cochlea, the auditory nerve, direct sound and the first reflection (Dt1), and (2) the
and in the two cerebral hemispheres. Once effective subsequent reverberation time (Tsub). The two spatial
models of auditory processing are developed, designs factors are (1) the listening level and (2) the maximum
for concert halls can proceed in a straightforward magnitude of the IACF (IACC). The SVR- and EEG-
fashion, according to guidelines derived from the based neural correlates of the two temporal factors are
model.1 In addition, understanding the basic opera- associated with the left hemisphere, whereas the two
tions of the auditory system may lead to a new genera- spatial factors are associated with the right hemisphere.
tion of automatic systems for recognizing speech,4 Higher in the auditory pathway, we reconfirmed by
analyzing music,2 and identifying environmental noise MEG that the left cerebral hemisphere is associated
and its subjective effects.13 In more general terms, the with the delay time of the first reflection Dt1. We also
first book on a brain-grounded theory of temporal found that the duration of coherent alpha wave activity
and spatial design in architecture and the environment (effective duration of the ACF of the MEG response
was published in 2016.14 signal) directly corresponds to how much a given stim-
It is remarkable that the temporal discharge pat- ulus is preferred, that is, the scale value of individual
terns of neurons at the level of the auditory nerve subjective preference.25,26 The right cerebral hemi-
and brainstem include sufficient information to effec- sphere was activated by the typical spatial factor, that
tively represent the ACF of an acoustic stimulus. Mech- is, the magnitude of IACC.27 The information corre-
anisms for the neural analysis of interaural time sponding to subjective preference of sound fields was
differences through neural temporal cross-correlation found in the effective duration of the ACF of the alpha
operations and for analysis of stimulus periodicities waves of both EEG and MEG recordings. The repetitive
through neural temporal autocorrelations were pro- feature of the alpha wave as measured in its ACF was
posed over half a century ago.15-17 Since then, many observed at the preferred condition. This evidence can
electrophysiological studies based on single neurons be pragmatized by applying the basic theory of subjec-
and neural populations have more clearly elucidated tive preference to music and speech signals for each in-
the neuronal basis for these operations. Binaural dividual’s preference.2
cross-correlations are computed by axonal tapped We also investigated temporal aspects of sensation,
delay transmission lines that feed into neurons in the such as pitch or the missing fundamental,28 loudness,29
medial superior nucleus of the auditory brainstem timbre,30 and the duration of sensation.31 These are
and act as coincidence detectors.18 If one examines well described by the temporal factors extracted from
the temporal patterning of discharges in the auditory the ACF.32,33 Remarkably, the temporal factors of
nerve,19 one immediately sees the basis for a robust sound fields such as Dt1 and Tsub are associated with
time-domain representation of the acoustic stimulus. left hemisphere responses.24,34-37 Typically, aspects of
Here, the stimulus autocorrelation is represented sound fields involving spatial percepts such as subjec-
directly in the interspike interval distribution of the tive diffuseness38 and the apparent source width
entire population of auditory nerve fibers.20,21 This (ASW) have been investigated,32,39 which are associated
autocorrelation-like neural representation subserves with right hemisphere responses.1,2,26,35,40,41 Tests on
the perception of pitch and tonal quality (aspects of dissimilarity judgments were conducted in an existing
timbre based on spectral contour).22,23 hall in relation to both temporal and spatial factors.42
CHAPTER 1 Introduction 3

Features of the IACF correspond to binaural percep- the listener is especially important in the presence of
tual attributes of binaural listening level, sound direc- other speakers and surrounding noise, both of which
tion, ASW, and subjective diffuseness (envelopment). are conditions that may separate the perceived signal
Neural correlates of ACF-related monaural percepts, from the target voice due to the IACF mechanism.
which we called “temporal percepts,” were observed in Because individual differences of subjective prefer-
electrical and magnetic neural responses over the left ce- ence in relation to IACC of spatial factors are very small
rebral cortical hemisphere, whereas those of binaural (nearly everyone has the same basic preferences), we
IACF-related percepts, which we called “spatial per- can determine the architectural spatial form of a room
cepts,” were observed over the right hemisphere.3 The by first taking common preferences into account. The
correlational features of primary importance to speech temporal factors, which involve successive delays pro-
recognition lie in the monaural ACF, which could duced by sets of reflective surfaces, are closely related
help suppress environmental noise, and in the IACF, to the dimensions of a specific room/concert hall. These
which could help suppress unwanted conversations of dimensions can be altered to optimize the space due to
other people (a spatial attribute that can largely be the minimum effective duration of the running ACF for
ignored in telephone communication). specific types of sounddmusic, such as organ music,
chamber music, or choral works, or speech.2

THEORY OF SUBJECTIVE PREFERENCE


FOR SOUND FIELDS EXAMPLES OF APPLICATION
Subjective preference of sound fields is deeply related to The above-mentioned correlation model in the audi-
speech identification and clarity. Preferences present tory system can be applied to both monaural and
themselves to us as the most primitive responses that binaural speech intelligibility configurations, and to
steer organisms in the direction of maintaining and recording identification and simultaneous translation
propagating life, and are therefore always as relative as into different languages.
they are unique. In humans, preferences are deeply It is often said that children dislike using hearing
related to the sense of aesthetics. Therefore, making aids because the models are usually designed by testing
absolute judgments is problematic for reliable resultsd only the hearing level. This volume proposes a possible
needless to say, arriving at a result that questions its future direction that involves applying the theory of
own objectivity does not constitute reliable informa- subjective preference to hearing aid design and includes
tion. Instead, preferences should be judged in a relative testing and accommodating individual abilities and
manner, such as those enabled by the paired compari- temporal and spatial percept preferences to increase
son test (PCT). It is the simplest and most accurate personal satisfaction.
method, and permits both experienced and inexperi-
enced persons to participate, starting from, for example,
2 years of age when the brain is almost developed. The REFERENCES
1. Ando Y. Concert Hall Acoustics. Heidelberg: Springer-Verlag;
resulting scale values are appropriate for a wide range of
1985 [Chapters 1 through 5].
applications. From the results of subjective preference
2. Ando Y. Architectural Acoustics, Blending Sound Sources,
studies with regard to temporal and spatial factors of Sound Fields, and Listeners. New York: AIP Press/Springer-
the sound field, we established the theory of subjective Verlag; 1998 [Chapters 1 through 6].
preference.1,2,10,43 3. Ando Y, ed. Cariani, Auditory and Visual Sensations. New
Over several decades, mainly in the context of archi- York: Springer-Verlag; 2009.
tectural acoustics and concert hall design, we have 4. Ando Y. Autocorrelation-based features for speech
developed a comprehensive theory of auditory signal representation. Acta Acust United Acust. 2015;101:
processing that is based on two internal auditory repre- 145e154.
sentations, the monaural ACF and the binaural IACF. 5. Damaske P, Ando Y. Interaural cross-correlation for multi-
channel loudspeaker reproduction. Acust. 1972;27:
The present work extends this general auditory signal
232e238.
processing theory to handle speech distinctions. Fea-
6. Ando Y, Kageyama K. Subjective preference of sound with
tures of the two correlation-based representations a single early reflection. Acustica. 1977;37:111e117.
predict major auditory percepts that are associated 7. Ando Y. Subjective preference in relation to objective pa-
with nonspatial temporal sound qualities and spatial rameters of music sound fields with a single echo.
attributes, respectively. For example, conference rooms J Acoust Soc Am. 1977;62:1436e1441.
can be designed by applying this preference theory for 8. Ando Y, Gottlob D. Effects of early multiple reflection on
mainly speech signals to maximize clarity and intelligi- subjective preference judgments on music sound fields.
bility. Facilitating communication of information for J Acoust Soc Am. 1979;65:524e527.
4 Signal Processing in Auditory Neuroscience

9. Ando Y, Alrutz H. Perception of coloration in sound fields field. J Temporal Des Architect Environ. 2003;3:60e69.
in relation to the autocorrelation function. J Acoust Soc Am. http://www.jtdweb.org/Journal/.
1982;71:616e618. 28. Inoue M, Ando Y, Taguti T. The frequency range applicable
10. Ando Y. Calculation of subjective preference at each seat in to pitch identification based upon the auto-correlation
a concert hall. J Acoust Soc Am. 1983;74:873e887. function model. J Sound Vib. 2001;241:105e116.
11. Ando Y. Investigations on cerebral hemisphere activities 29. Sato S, Kitamura T, Sakai H, Ando Y. The loudness of
related to subjective preference of the sound field, pub- “complex noise” in relation to the factors extracted from
lished for 1983e2003. J Temporal Des Archit Environ. the autocorrelation function. J Sound Vib. 2001;241:
2003;3:2e27. 97e103.
12. Ando Y. On the temporal design of environments. 30. Hanada K, Kawai K, Ando Y. A study of the timbre of an elec-
J Temporal Des Architect Environ. 2004;4:2e14. http:// tric guitar sound with distortion. Proceedings of the 3rd Interna-
www.jtdweb.org/journal/. tional Symposium on Temporal Design. Guangzhou: J South
13. Soeta Y, Ando Y. Neurally Based Measurement and Evaluation China University of Technology (Natural Science Edition);
of Environmental Noise. Tokyo: Springer; 2015. 2007:96e99.
14. Ando Y. Brain-Grounded Theory of Temporal and Spatial 31. Saifuddin K, Matsushima T, Ando Y. Duration sensation
Design in Architecture and the Environment. Tokyo: Springer; when listening to pure tone and complex tone.
2016. J Temporal Des Architect Environ. 2002;2:42e47. http://
15. Jeffress LA. A place theory of sound localization. J Comp www.jtdweb.org/Journal/.
Physiol Psychol. 1948;41:35e39. 32. Ando Y, Sakai H, Sato S. Formulae describing subjective at-
16. Licklider JCR. A duplex theory of pitch perception. tributes for sound fields based on a model of the auditory-
Experientia. 1951;VII:128e134. brain system. J Sound Vib. 2000;232:101e127.
17. Cherry EC, Sayers BMA. “Human ‘cross-correlator’”da 33. Ando Y. Correlation factors describing primary and spatial
technique for measuring certain parameters of speech sensations of sound fields. J Sound Vib. 2002;258:405e417.
perception. J Acoust Soc Am. 1956;28:889e895. 34. Ando Y, Kang SH, Morita K. On the relationship between
18. Colburn S. Computational models of binaural processing. auditory-evoked potential and subjective preference for
In: Hawkins H, McMullin T, Popper AN, Fay RR, eds. Audi- sound field. J Acoust Soc Jpn (E). 1987;8:197e204.
tory Computation. New York: Springer-Verlag; 1996. 35. Ando Y. Evoked potentials relating to the subjective prefer-
19. Secker-Walker HE, Searle CL. Time domain analysis of ence of sound fields. Acustica. 1992;76:292e296.
auditory-nerve-fiber firing rates. J Acoust Soc Am. 1990;88: 36. Ando Y, Chen C. On the analysis of the autocorrelation
1427e1436. function of a-waves on the left and right cerebral hemi-
20. Cariani PA, Delgutte B. Neural correlates of the pitch of spheres in relation to the delay time of single sound
complex tones. I. Pitch and pitch salience. J Neurophysiol. reflection. J Architect Plann Environ Eng, AIJ. 1996;488:
1996a;76:1698e1716. 67e73.
21. Cariani PA, Delgutte B. Neural correlates of the pitch of 37. Chen C, Ando Y. On the relationship between the autocor-
complex tones. II. Pitch shift, pitch ambiguity, phase- relation function of the a-waves on the left and right cere-
invariance, pitch circularity, and the dominance region bral hemispheres and subjective preference for the
for pitch. J Neurophysiol. 1996b;76:1717e1734. reverberation time of music sound field. J Architect Plann
22. Meddis R, O’Mard L. A unitary model of pitch perception. Environ Eng, AIJ. 1996;489:73e80.
J Acoust Soc Am. 1997;102:1811e1820. 38. Ando Y, Kurihara Y. Nonlinear response in evaluating the
23. Cariani P. Temporal coding of periodicity pitch in subjective diffuseness of sound field. J Acoust Soc Am. 1986;
the auditory system: an overview. Neural Plast. 1999;6: 80:833e836.
147e172. 39. Sato S, Ando Y. On the apparent source width (ASW) for
24. Ando Y, Yamamoto K, Nagamatsu H, Kang SH. Auditory bandpass noises related to the IACC and the width of
brainstem response (ABR) in relation to the horizontal the interaural cross-correlation function (WIACC). J Acoust
angle of sound incidence. Acoust Lett. 1991;15:57e64. Soc Am. 1999;105:1234.
25. Soeta Y, Nakagawa S, Tonoike M, Ando Y. Magnetoence- 40. Ando Y, Hosaka I. Hemispheric difference in evoked po-
phalographic responses corresponding to individual sub- tentials to spatial sound field stimuli. J Acoust Soc Am.
jective preference of sound fields. J Sound Vib. 2002;258: 1983;74(S1):S64eS65(A).
419e428. 41. Ando Y, Kang SH, Nagamatsu H. On the auditory-evoked
26. Soeta Y, Nakagawa S, Tonoike M, Ando Y. Spatial analysis potentials in relation to the IACC of sound field. J Acoust
of magnetoencephalographic alpha waves in relation to Soc Jpn (E). 1987;8:183e190.
subjective preference of a sound field. J Temporal Des 42. Hotehama T, Sato S, Ando Y. Dissimilarity judgments in
Architect Environ. 2003;3:28e35. http://www.jtdweb.org/ relation to temporal and spatial factors for the sound fields
Journal/. in an existing hall. J Sound and Vib. 2002;258:429e441.
27. Sato S, Nishio K, Ando Y. Propagation of alpha waves cor- 43. Ando Y. Concert hall acoustics based on subjective prefer-
responding to subjective preference from the right hemi- ence theory. In: Rossing TD, ed. Springer Handbook of
sphere to the left with change in the IACC of a sound Acoustics. New York: Springer-Verlag; 2007 [Chapter 10].
CHAPTER 2

Human Hearing System

PHYSICAL SYSTEMS OF THE HUMAN EAR of a transfer function from a sound source in front of
Head, Pinna, and External Auditory Canal the listener to the eardrum is shown in Fig. 2.3. This cor-
An acoustic signal is perceived by the ears, in which a responds to direct sound when the listener is facing a
sound signal is given by a time sequence. The three- speaker. The transfer functions obtained by three re-
dimensional space is also perceived by the two ears. ports1-3 are not significantly different for frequencies
This is due mainly to the head-related transfer functions up to 10 kHz.
Hl,r(r/r0, u) between a source point and the two ear
entrances, which have directional qualities based on Eardrum and Bone Chain
the shape of the head and the pinna system. The direc- Behind the eardrum are the tympanic cavities, which
tional information is contained in such head-related contain the three auditory ossicles: the malleus, incus,
transfer functions, including the interaural time differ- and stapes. This area is called the middle ear (Fig. 2.4).
ence and the interaural amplitude difference.
Fig. 2.1 shows examples of the amplitude of the
head-related transfer function H(x,h,u) as parameters Amplitude
of the vertical angle of incidence h (x ¼ 0), x being
10 dB η
the horizontal angle. These were measured by the
single-pulse method in far-field conditions.1 The angle 9°
h ¼ 0 , x ¼ 0 corresponds to the frontal direction 9°
and h ¼ 90 to the upper direction. In this situation, 27°
the time difference between two ears is sIACC ¼ 0 , 27°
and the only difference is the angular frequency charac- 45° 45°
teristic, u.
Because the diameter of the external canal is small 63° 63°
enough compared to the wavelength below 8 kHz, the 85°
transfer function of the entrance canal E(u) is indepen- 85°
⏐H(ξ,η,ω)⏐

dent of the directions in which sound is incident to the


99° 99°
human head for the audio frequency range:
117°
EðuÞ w El;r ðx;h;uÞ w El;r ðuÞ 2.1 117°
Thus, interaction between the sound field in the 135°
135°
external canal and that on the outside, including
153° 153°
the pinna, is insignificant. The transfer function from
the free field to the eardrum can be obtained by multi- 171° 171°
plying the following two functions.
(1) The sound field from the sound source in the free
field to the ear canal entrances, Hl,r(x,h, u) and (2) the
0.2 0.5 1 2 5 10 15
sound field from the entrance to the eardrum, E(u), so
Hl;r ðx;h; uÞEðuÞ. Frequency [kHz]
FIG. 2.1 Transfer functions (amplitude) from a free field to the
Measured absolute values of E(u) are shown in Fig. 2.2, ear-canal entrance as a parameter of the horizontal angle x.
where variations in the curves obtained by different (From Mehrgardt S, Mellert V. Transformation characteristics
investigations are caused mainly by the different defini- of the external human ear. J Acoust Soc Am. 1977;61:
tions of the ear-canal entrance point. A typical example 1567e1576.)

5
6 Signal Processing in Auditory Neuroscience

20
Amplitude

[dB]
10

| E(ω) |
0

–10
0.2 0.5 1 2 5 10 15
Frequency [kHz]
FIG. 2.2 Transfer functions of the ear canal. ([————], From Wiener FM, Ross DA. The pressure distribution
in the auditory canal in a progressive sound field. J Acoust Soc Am. 1946;18:401e408; [......], From Shaw
[1974]; [____], From Mehrgardt S, Mellert V. Transformation characteristics of the external human ear. J Acoust
Soc Am. 1977;61:1567e1576.)

20 5.1
[dB]

Amplitude 1.2
10 2.8
4.4
5.9
⏐H(ω) E(ω)⏐

0
7.5
5.1
–10 8.2

–20 3.5
0.2 0.5 1 2 5 10 15
4.4
Frequency [kHz]
FIG. 2.5 Contour lines of equal amplitude of human
FIG. 2.3 Transfer functions to the eardrum from a sound eardrum vibration at 525 Hz (121 dB SPL). Each value
source in front of the listener. ([————], From Wiener FM, should be multiplied by 105 cm. (From Tonndorf J, Khanna
Ross DA. The pressure distribution in the auditory canal in a SM. Tympanic-membrane vibrations in human cadaver ears
progressive sound field. J Acoust Soc Am. 1946;18: studied by time-averaged holography. J Acoust Soc Am.
401e408; [......], From Shaw [1974]; [____], From Mehrgardt S, 1972;52:1221e1233.)
Mellert V. Transformation characteristics of the external
human ear. J Acoust Soc Am. 1977;61:1567e1576.) The sound pressure striking the eardrum is transduced
into vibration. The middle-ear ossicles transmit the
vibration to the cochlea. The vibration pattern of the
Semicircular canal human eardrum was first measured by Bekesy,4 who per-
Incus
formed a point-by-point examination with an electric
Malleus Footplate or stapes capacitive probe. Later, Tonndorf and Khanna5
in oval window measured the vibration pattern by time-averaged holog-
raphy, which allows perception of finer vibration
Cochlear
External canal patterns on the eardrum, as shown in Fig. 2.5. Note
nerve
that the outline of the malleus is visible in the pattern
Cochlea at the amplitude value of 3.5. The vibration on the
Eardrum malleus is transmitted to the incus and the stapes.
Round The transfer function C(u) of the human middle ear
window (three auditory ossicles) between the sound pressure at
Auditory tube the eardrum and the apparent sound pressure on the
FIG. 2.4 Schematic illustration of the human ear. (Modified cochlea is plotted in Fig. 2.6. Data were obtained by
from Dorland, W.A.N. (1947). The American Illustrated Onchi6 and Rubinstein7 from cadavers. The values
Medical Dictionary. 24th ed. Saunders, Philadelphia.) have been rearranged by the Ando.8
CHAPTER 2 Human Hearing System 7

The maxima at 1 kHz are adjusted to the same value.


Later, Puria, Rosowski, and Peake9 made measurements
by a system that included a hydropressure transducer
used in the vestibule as shown in Fig. 2.7. The hydro-
⏐C(ω)⏐

pressure transducer and the microphone with identical


10 dB sound pressure stimuli in air produced estimates of
pressure within 0.5 dB for the range of 50 Hz to 11
kHz. The results at the sound pressure levels of 106,
112, and 118 dB indicating similar values are shown
0.1 0.2 0.5 1 2 5 10
in Fig. 2.8. These results agree well with the data shown
Frequency [kHz] in Fig. 2.6, as far as relative behavior is concerned. The
FIG. 2.6 Transfer function (relative amplitude) of the human transfer function measured at 124 dB showed some
middle ear between the sound pressure at the eardrum and signs of nonlinearity, but was consistent with a linear
the apparent pressure on the cochlea. (C), Average value
system below approximately 118 dB. The magnitude
measured (modified from Onchi, 1961); (B), measured value
of the middle-ear pressure gain is about 20 dB in the fre-
(Rubinstein, 1966.)
quency range from 500 Hz to 2 kHz.

Sound
source
Lateral

Posterior
Sound
delivery
tube
Microphone
Knowles EK-3133
Brass
coupling Static
rings Acoustic
pressure
resistor
vent
PEC Nylon
screen Cotton
Enlarged fiber
Metal
Eustachian
screen
tune Dental
TM acrylic
Flush
outlet
Pv Mastoid

5 mm
Cochlear
turns Enlarged
internal Flush
Hydro- auditory
pressure inlet
canal
transducer
FIG. 2.7 Measurement system of middle ear transfer function. To measure the inner-ear pressure, a
hydropressure transducer was placed in the vestibule facing the stapes. In order to ensure that the cochlea
remains fluid filled during the measurement, an inlet flush tube was cemented into the superior semicircular
canal and an outlet flush tube was cemented into the apical turn of the cochlea. (Puria S, Rosowski JJ, Peake
WT. Middle-ear pressure gain in humans: preliminary results. In: Duifhuis H, Horst JW, Dijk P, Netten SM, eds.
Proceedings of the International Symposium on Biophysics of Hair Cell Sensory Systems. Singapore: World
Scientific; 1993:345e351.)
8 Signal Processing in Auditory Neuroscience

30

20
⏐C(ω)⏐

Sensitivity of ear
⏐S(ω)⏐
10

10 dB
0
0.2 0.5 1 2 5 10
Frequency [kHz]
FIG. 2.8 Transfer function of the human middle ear between
0.2 0.5 1 2 5 10
the sound pressure at the eardrum and the inner-ear
pressure. The global behavior is surprisingly similar to that in Frequency [kHz]
Fig. 2.6. (Puria S, Rosowski JJ, Peake WT. Middle-ear FIG. 2.9 Sensitivity of the human ear to a sound source in
pressure gain in humans: preliminary results. In: Duifhuis H, front of listeners. (____), Normal hearing threshold (ISO
Horst JW, Dijk P, Netten SM, eds. Proceedings of the recommendation); (......), reexamined in the low-frequency
International Symposium on Biophysics of Hair Cell Sensory range. (C, B), Transformation characteristics between the
Systems. Singapore: World Scientific; 1993:345e351.) sound source and the cochlea, S(w) ¼ H(w)E(w)C(w); (C),
data obtained from measured values C(w) by Onchi (1961),
and (B), from Rubinstein (1966), which are combined with the
transfer function H(w)E(w) measured by Mehrgardt and
Mellert (1977). (Berger EH. Re-examination of the low-
For the usual sound field, the transfer function
frequency (50e1000 Hz) normal threshold of hearing in free
between a sound source located in front of the listener and diffuse sound fields. J Acoust Soc Am. 1981;70:
and the cochlea can be represented by 1635e1645.)
SðuÞ ¼ Hð0; 0;uÞEðuÞCðuÞ. (2.1)
The values are plotted in Fig. 2.9 based on cadaver data
from Onchi6 and Rubinstein7. The pattern of the trans- AUDITORY BRAINSTEM RESPONSES
fer function agrees with ear sensitivity for people with IN AUDITORY PATHWAYS
normal hearing ability, so ear sensitivity can be charac- A possible mechanism for a spatial factor is the
terized primarily by the transfer function from the free maximum value of the interaural cross-correlation func-
field to the cochlea Zwislocki10. Better agreement can tion (IACC), between sound signals arriving at the two
be obtained by reexamining the values in the low- ear entrances for percepts of localization, apparent source
frequency range Berger11. width (ASW), and subjective diffuseness. The left and
right auditory-brainstem responses (ABRs) were recorded
The Cochlea to justify such a mechanism for spatial information
The stapes, which is the smallest bone in the human Ando, Yamamoto, Nagamatsu and Kang12.
body, is also the last of the three auditory ossicles. It is
connected to the oval window, and drives the fluid in Auditory-Brainstem Response Recording
the cochlea, producing a traveling wave along the basilar and Flow of Neural Signals
membrane. The cochlea contains the sensory receptor As a source signal p(t), a short-pulse signal (50 ms) was
organ on the basilar membrane, which transforms the supplied to a loudspeaker with frequency characteristics
fluid vibration into a neural code, as shown in for 100 Hz to 10 kHz, 3 dB. This signal was repeated
Fig. 2.10. The basilar membrane is so flexible that each every 100 ms for 200 seconds (2000 times) to be inte-
section can move independently of the neighboring grated simultaneously, and left and right ABRs were
section. The traveling waves on the basilar membrane recorded through electrodes placed on the vertex
observed by Bekesy4 and shown in Fig. 2.11A and B, and left and right mastoids. The distance between
are consistent with this representation. loudspeakers and the center of the head was kept at
CHAPTER 2 Human Hearing System 9

z Scala vestibuli
x
Reissner’s
membrane Scala media

Tectorial membrane
Outer hair
cells

Spiral
ganglion Inner hair Basilar
cell membrane
axon Nerve fiber

Scala tympani
Capsule of
gang. cell

FIG. 2.10 Cross section through the cochlea showing the fluid-filled canals and the basilar membrane
supporting hair cells. (Modified from Rasmussen AT. Outline of Neuro-Anmy. 3rd ed. Dubuque, IA: William
C. Brown; 1943.)

300~ 200~ 100~ 50~


Amplitude

20 25 30 35
A Distance from stapes [mm]

π
Δφ = · 200 Hz
2
Amplitude

20 22 24 26 28 30 32

B Distance from stapes [mm]


FIG. 2.11 Envelope of the traveling wave (A), and traveling waves on basilar membrane at 200 Hz (B). (Bekesy
G. Experiments in Hearing [Wever E, transl. and ed.]. New York: McGraw-Hill; 1960.)
10 Signal Processing in Auditory Neuroscience

Left ABR subject : MR Right ABR shown in Fig. 2.13B; l > r for x ¼ 60 and 90 (P <
ξ .05). The behavior of wave III, shown in Fig. 2.13C, is
ξ: similar to that in wave I; r > l for x ¼ 30 e 120
0° (P < .01). This tendency is again reversed in wave IV
as shown in Fig. 2.13D; l > r for x ¼ 60 e 150 (P <
30° .05), and this is maintained further in wave VI as shown
in Fig. 2.13F, even though absolute values are ampli-
60°
IVV
I I VII fied; l > r for x ¼ 60 e 150 (P < .05). From this evi-
Amplitude of ABR

IVrVr VI dence, it is likely that the flow of neural signals is


II IIIIII r
I Ir II IIIr interchanged three times between the cochlear nucleus,
r
90°
the superior olivary complex, and the lateral lemniscus
as shown in Fig. 2.14 for this spatial information pro-
120° cess. The interchanges at the inferior colliculus may be
operative for interaural signal processing as discussed
150° later.
In wave V, shown in Fig. 2.13E, such a reversal
180° 0.5 μv
cannot be seen, and the relative behavior of amplitudes
0 5 10 0 5 10 of the left and right are parallel and similar. Thus, these
Latency [ms] two amplitudes were averaged and plotted in Fig. 2.17
FIG. 2.12 Examples of auditory brainstem response (ABR) (symbols V). In this figure, the amplitudes of wave IV
obtained between the vertex and left and right mastoids, as (left and right, symbols l and r) are also plotted in refer-
a function of the latency less than 10 ms and a parameter of ence to the ABR amplitudes at frontal sound incidence.
the horizontal angle of sound incidence. The abscissa is the Concerning the latencies of waves I through VI rela-
latency in the auditory pathways relative to the time when the tive to the time when the short pulse was supplied to
single pulse arrives at the right ear entrance. Arrows indicate the loudspeaker, the behaviors indicating relatively
the time delay, depending upon the sound source location of short latencies in the range around x ¼ 90 were similar
the right-hand side of the subject, and the null amplitude of
(Fig. 2.16). It is remarkable that a significant difference
ABR. The wave number is defined by the symbol from Il,r to
VIl,r, which is reflected by the activity at each nucleus (relay
is achieved (P < .01) between averaged latencies at
station) in the auditory systems. The suffix signifies the left x ¼ 90 , and those at x ¼ 0 (or 180 , i.e., a difference
and right auditory pathway. (Ando, Yamamoto, Nagamatsu of about 640 ms on average, which corresponds to
and Kang, 1991.) the interaural time difference of sound incident at
x ¼ 90 ). It is most likely that the relative latency at
wave III may be reflected in the interaural time differ-
ence. No significant differences could be seen between
68  1 cm. The loudspeakers were located on the right- the latencies of the left and right of waves I to IV, as indi-
hand side of the subject. cated in Fig. 2.16.
Examples of recorded ABR as a parameter of the hor-
izontal angle of sound incidence of one of four subjects Auditory-Brainstem Response Amplitudes
are shown in Fig. 2.12. It is evident that waves I to VI in Relation to Interaural Cross Correlation
from the vertex and the right mastoid differ in amplitude Fig. 2.17 shows values of the magnitude of interaural
as indicated by each curve. The ABR data were quite cross correlation and the autocorrelation functions
similar among the four subjects who participated, and (ACFs) at the time origin. These were measured at the
thus data for the four subjects (23  2 years of age, two ear entrances of a dummy head as a function
male) were averaged. As shown in Fig. 2.13A (wave I), of the horizontal angle after passing through the
of particular interest is the fact that amplitudes from A-weighting networks (nearly characteristic of ear sensi-
the right, which may correspond to the sound pressure tivities). The averaged amplitudes of waves IV (left and
from the source located on the right-hand side, are right) and averaged amplitudes of wave V, which were
greater than those from the left; r > l for x ¼ 30  both normalized to the amplitudes at the frontal inci-
130 (P < .01). This tendency is reversed in wave II as dence, are shown in Fig. 2.15.
Another random document with
no related content on Scribd:
¿porqué? Ellos me dixeron[633];
allá os lo dirá el juez. Entonçes
me pareçió que no estaua
cansada mi triste ventura de me
tentar, pero que començaua
desde aqui de nueuo a me
perseguir. Començose de la gente
que acompañaua la justicia a
murmurar[634] que yo yua preso
por adultero. Dezian todos
quantos lo sabian mouidos de
piedad; ¡o quanto te fuera mejor
que huuieras muerto a manos de
turcos, antes que ser traydo a
poder de tus enemigos! ¡O
soberano Dios! que no queda
pecado sin castigo; y quando yo
esto oía Dios sabe lo que mi
anima sentia. Pero quierote dezir
que avnque siempre tube
confiança que la verdad no podia
pereçer[635], yo quisiera ser mil
vezes muerto antes que venir a
los ojos de Arnao. Ni sabía cómo
me defender yo; antes me
determiné dexarme condenar
porque él satisfiziesse su honrra,
teniendo por bien enpleada la
vida pues por él la tenia yo; y ansi
dezia yo hablando comigo; ¡o si
condenado por el juez fuesse yo
depositado en manos del burrea
que me cortasse la cabeça sin yo
ver a Arnao! Con esto me
pusieron en vna muy horrible
carçel que tenia la çiudad, en vn
lugar muy fuerte y muy escondido
que auia para los malhechores
que por inormes delitos eran
condenados a muerte, y alli me
cargaron de hierros teniendolo yo
todo por consolaçion. Todos me
mirauan con los ojos y me
señalauan con el dedo auiendo
de mí piedad: y avnque ellos
tenian neçesidad della, mi miseria
les hazia oluidarse de sí. En esto
passé aquella noche con lo que
auia passado del dia hasta que
vino a visitar y proueer en los
delitos de la carçel, y ansi en vna
gran sala sentado en vn soberuio
estrado y teatro de gran
magestad, delante de gran
multitud de gente que a demandar
justiçia alli se juntó, el gouernador
por la importunidad de Arnao
mandó que me truxiessen delante
de sí, y luego fueron dos porteros
en cuyas manos me depositó el
alcayde por mandado del juez, y
con una gruesa cadena me
presentaron en la gran sala. Tenia
yo de empacho incados los ojos
en tierra que no los osaua alçar
por no mirar a Arnao: de lo qual
todos quantos presentes estauan
juzgauan estar culpado del delito
que mi contrario y acusador me
imponia. Y ansi mandando el
gouernador a Arnao que
propusiesse la acusaçion ansi
començó. ¡O bienauenturado
monarca por cuya rectitud y
equidad es mantenida de justiçia
y paz esta tan yllustre y
resplandeçiente republica, y no
sin gran conoçimiento y
agradeçimiento de todos los
subditos! Por lo qual sabiendo yo
esto en dos años passados que
vusco en Ingalaterra, Brauante,
Flandes y por toda la Italia a este
mi delinquente me tengo por
dichoso por hallarle debajo de tu
señoria y jurisdiçion, confiando
por solo tu prudentissimo juizio
ser restituido en mi justiçia[636] y
ser satisfecho en mi voluntad; y
por que no es razon que te dé
pessadumbre con muchas
palabras, ni inpida a otros el
juizio, te hago saber que este que
aqui ves que se llama Alberto de
Clep... Y hablando comigo el juez
me dixo: ¿vos, hermano, llamais
os ansi? Y yo respondi: el mesmo
soy yo. Boluio Arnao y dixo: El es
o justissimo monarca: él es, y
ninguna cosa de las que yo dixere
puede negar. Pues este es vn
hombre el mas ingrato y oluidado
del bien que nunca en el mundo
nació. Por lo qual solamente le
pongo demanda de ser ingrato
por acusaçion, y pido le des el
castigo que mereçe su ingratitud,
y por más le conuençer pasa ansi:
que avnque las buenas obras no
se deuen referir del animo liberal,
porque sepas que no encarezco
su deuda sin gran razon, digo que
yo le amé del mas firme y
constante amor que jamas vn
hombre a otro amó; y porque
veas que digo la verdad sabras
que vn dia por çierto negoçio que
nos conuenia partimos ambos de
Françia para yr en Ingalaterra, y
entrando en el mar nos sobreuino
vna tempestad la mas horrenda y
atroz que a nauegantes suçedió
en el mar. En fin con la alteraçion
de las olas y soberuia de los
çielos nos pareció a todos que era
buelto el dilubio de Noe. Cayó él
en el agua por desgraçia y
indispusiçion, y procurando cada
qual por su propria salud y
remedio, en la mas obscura y
espantosa noche que nunca se
vio me eché al agua y peleando
con las inuençibles olas le truxe al
puerto de salud. Suçede despues
desto que tengo yo vna muger
moça y hermosa (que nunca la
huuiera de tener, porque no me
fuera tan mala ocasion) y está
enamorada de Alberto como yo lo
soy, que della no es de marauillar,
pues yo le amo mas que a mí; y
ella persiguiendole por sus
amores la responde él que en
ninguna manera puede en la fe
ofender a Arnao, y siendo por ella
muchas vezes requerido vino a
las manos con él queriendole
forçar, y passa ansi que vna
mañana yo me leuanté dexandola
a ella en la cama y por limpiar mi
cuerpo me lançé a vn retrete sin
me ver ella. De manera que ella
pensó que yo era salido de casa a
negoçiar, y suçedio entrar por alli
Alberto por saber de mí, y ella
asegurada que no la viera yo le
hizo con importunidad llegar a la
cama donde estaua, y tomandole
fuertemente por la capa le dixo:
duerme comigo que muero por ti;
y Alberto respondio: todas las
cosas de su casa y hazienda fió
de mí Arnao, y sola a ti reseruó
para sí: por tanto señora, no
puedo hazer esa tu voluntad; y él
luego se fue que hasta oy no
pareçio; y como ella se sintio
menospreçiada y que se yua
Alberto huyendo dexando la capa
en las manos començo a dar
grandes bozes llamandome a mi
porque viesse o de quién solia yo
confiar; y como del retrete salí, y
conoçio que de todo auia yo sido
testigo, de empacho y afrenta
enmudeçio, y subitamente de ay a
pequeño rato murio; y como tengo
hecha bastante esperiençia de
quién me tengo de fiar, pues
mucho más le deuo yo a él que él
a mí, sin comparación, pues si yo
le guardé a él la vida, él a mí la
honrra que es mucho más, agora,
justissimo monarca, yo te
demando que me condenes por
su deudor y obligado a que
perpetuamente le aya yo a él de
seruir: que yo me constituyo por
su perpetuo seruidor[637]; y si
dixere que por auerle yo dado la
vida en la tempestad me haze
graçia de la libertad, a lo menos
neçesitale a que por ese mesmo
respeto me tenga en la vida
compañia, pues por su causa
perdí la de mi muger; y diziendo
esto Arnao calló esperando la
sentençia del juez. Pues como yo
entendi por la proposiçion de
Arnao que auia estado presente a
lo que con su Beatriz passé, y
que yo no tenia neçesidad de me
desculpar, porque esto era lo que
más lastimado y encogido tenia
mi coraçon hasta aqui, luego alçé
mi cabeça y lançé mis ojos en
Arnao, y con ellos le agradeçí el
reconoçimiento que tenia de mi
fidelidad, y aguardé con mucha
humildad y mansedumbre la
sentençia del juez, esperando que
sobre el seguro que yo tenia de
Arnao, y con el que él auia
mostrado de mi, ningun daño me
podia suçeder; y ansi todos
quantos al rededor estauan se
alegraron mucho quando oyeron
a Arnao y entendieron dél su
buena intinçion, y que no
pretendia en su acusaçion sino
asegurarme para nuestra amistad
y que fuesse confirmada y
corroborada por sentençia de
juez, y ansi todos con gran rumor
encareçian vnos con otros la
amistad y fe de Arnao y se
ofreçian por mi que no apelaria de
ningun mandado del juez, pues
me era notorio el seguro de mi
amigo Arnao; y haziendo callar el
gouernador la gente se boluio
para mí y me dixo. Di tú, Alberto
¿qué dizes a esto que contra ti se
propone? ¿Es verdad?
Respondi yo: señor, todo quanto
Arnao ha dicho todo es conforme
a verdad, y no auia otra cosa que
yo pudiesse alegar para en
defensa de mi persona si alguna
culpa se me pudiera imponer sino
lo que Arnao ha propuesto:
porque hasta agora no padeçia yo
otra confusion sino no saber
cómo le pudiera yo persuadir la
verdad. Lo qual de oy mas no
tengo porque trabajar pues Arnao
estuuo presente a lo que passé
con su muger. Por lo qual tú,
señor, puedes agora mandar, que
a mi no me resta sino obedeçer.
Luego dixo el juez: por çierto yo
estoy marauillado de tan
admirable amistad; en tanta
manera que me pareçe que
podeis quedar por exemplo de
buenos amigos para los siglos
venideros y ansi pues estais
conformes y çiertos ser en
vosotros vna sola y firme
voluntad, justa cosa es segun mi
pareçer que sea puesto Alberto
en su libertad, y mando por mi
sentençia que le sea dado por
compañero perpetuo a[638] Arnao
en premio de su sancto y vnico
amor; y ansi me fueron luego
quitados los hierros y me vino
Arnao a abraçar dando graçias a
Dios pues me auia podido auer,
con protestaçion de nunca me
desamparar, y ansi nos fuemos
juntos a Paris perseuerando
siempre en nuestra amistad
mientra la vida nos duró.
Miçilo.—Por çierto, gallo,
admirable amigo te fue Arnao
quando te libró del mar pospuesto
el gran peligro a que las
soberuias hondas amenaçaban.
Pero mucho mayor sin
comparaçion me pareçe auerlo tú
sido a él, quando ofreçida la
oportunidad de goçar de su
graçiosa muger, por guardarle su
honrra con tanto peligro de tu vida
la huyste. Porque no ay animal
tan indignado y arriscado como la
muger si es menospreçiada
quando de su voluntad ofreçe al
varon su apetito y deleyte, y ansi
conuierte todo su amor en
verdadero odio deseando mil
muertes al que antes amó como a
sí; como hizo la muger de Putifar
a Joseph.
Gallo.—Çiertamente no teneis
agora entre vosotros semejantes
amigos en el mundo; porque
agora no ay quien tenga fe ni
lealtad con otro sino por grande
interese proprio y avn con este se
esfuerça hasta el peligro; el qual
como se ofreçe buelue las
espaldas; ya no hay de quién se
pueda fiar la vida, muger, honrra,
hazienda ni cosa que inporte
mucho menos.
Miçilo.—No hay sino amigos
para los plazeres, combites,
juegos, burlas, donayres y viçios.
Pero si se os ofreçe vna
neçesidad antes vurlarán de vos,
y os injuriarán que os sacaran
della. Como me contauan este dia
passado de vn Durango hombre
muy agudo y industrioso, que en
la uniuersidad de Alcala auia
hecho vna vurla a vn Hieronimo
su compañero de camara, que se
fió del ofreçiendose de le sacar de
vna afrenta y metiole en mayor; y
fue que siendo ambos
compañeros de camara y letras,
suçedió que vn dia vinieron a
visitar a Hieronimo vnos parientes
suyos de su tierra, y fue a tiempo
que el pobre mançebo no tenia
dineros, como aconteçe muchas
vezes a los estudiantes;
prinçipalmente si son passados
algunos dias que no les vino el
recuero que les suele traer la
prouision. Y porque los quisiera
combidar en su posada estaua el
más afrontado y triste hombre del
mundo. Y como Durango su
compañero le preguntó la causa
de su afliçion como doliendose
della, él le començó a consolar y
esforçar prometiendole el
remedio, y ansi le dixo: no te
aflixas, Hieronimo, por eso, antes
ve esta noche al meson y
combidalos que vengan mañana
a comer contigo, que yo proueere
de los dineros neçesarios entre
mis amigos; y el buen Hieronimo
confiandose de la palabra de su
compañero hizo lo que le mandó;
y ansi los huespedes aceptaron, y
el dia siguiente se leuantó
Durango sin algun cuydado de lo
prometido a Hieronimo y se fue a
su liçion y no boluio a la possada
hasta mediodia. Donde halló
renegando a Hieronimo de su[639]
descuydo que auia tenido; y el no
respondió otra cosa sino que no
auia podido hallar dineros entre
todos sus amigos; que el auia
hecho todo su poder; y estando
ellos en esta porfia llamaron a la
puerta los combidados, de lo qual
reçibio Hieronimo gran turbaçion
vuscando dónde poder huyr
aquella afrenta; y luego acudio
Durango por dar conclusion a la
vurla por entero diziendole que se
lançasse debajo de vna cama que
estaua alli, y que él los despideria
lo mejor que pudiesse cunpliendo
con su honrra; y ansi con la
turbacion que Hieronimo tenía le
obedecio, y los huespedes
subieron preguntando por
Hieronimo, los quales Durango
respondio: señores, él deseó
mucho combidaros a comer
avnque no tenia dineros,
pensando hallarlos entre [640] sus
amigos, y auiendolos vuscado,
como no los halló, de pura
verguença se ha lançado debajo
de esta cama por no os ver; y
ansi diziendo esto se llegó para la
cama alçando la ropa que
colgaua y le començo á
importunar con grandes vozes a
Hieronimo que saliesse, y el
pobre salio con la mayor afrenta
que nunca hombre reçibio, lleno
de pajas, flueco, heno y pluma y
tierra, y por ver reyr a todos[641],
quiso de afrenta matar a su
conpañero[642] si no le huyera.
Por lo cual los huespedes le
lleuaron consigo a su meson y
enbiaron luego por de comer para
todos, y trabajaron por le sosegar
quanto pudieron.
Gallo.—Desos amigos ay el dia
de hoy; que antes mofarán y
vurlarán de vos en vuestra
neçesidad que procurarán
remediarla.
Miçilo.—Por çierto tú dices
verdad, que en estos tiempos no
ay mejores amigos entre nosotros
que estos; mas antes muy
peores. Agora te ruego me digas,
¿en qué suçediste despues?
Gallo.—Despues te hago saber
que vine a naçer en la ciudad de
Mexico de vna india natural de la
tierra, en la qual me engendró un
soldado de la compañia de Cortés
marques del Valle, y luego en
naciendo me suçedio morir.
Miçilo.—Desdichado fueste en
luego padeçer la muerte; y
tanbien por no poder gozar de los
tesoros y riquezas que vienen de
allá.
Gallo.—¡O Miçilo! quan
engañado estás. De contraria
opinion fueron los griegos, que
fueron tenidos por los mas sabios
de aquellos tiempos; que dezian
que era mucho mejor, o nunca
naçer, o en naçiendo morir; yo no
sé porque te aplaze mas el viuir;
prinçipalmente vna vida tan
miserable como la que tienes tú.
Miçilo.—Yo no digo que es
miseria el morir sino por el dolor y
pena grande que la muerte da; y
ansi tengo lastima de ti porque
tantas vezes padeçiste este
terrible dolor, y ansi deseaua
mucho saber de ti por ser tan
esperimentado en el morir: ¿en
qué esta su terribilidad? Qverria
que me dixesses, qué ay en la
muerte que temer? Qué cosa es?
En qué está? Quién la siente?
Qué es en ella lo que da dolor?
Gallo.—Mira, Miçilo, que en
muchas cosas te engañas; y en
esa mucho mas.
Miçilo.—Pues ¿qué dicesmuerte
no da dolor?
Gallo.—Eso mesmo digo: lo qual
si atento estás façilmente te lo
probaré; y porque es venido el dia
dexalo para el canto que se
siguirá.

Fin del deçimo canto del Gallo.


NOTAS:
[618] G., tenia.
[619] (Tachado): Siguesse el deçimo canto del Sueño o Gallo de
Luciano, famoso orador griego, contrahecho en el castellano por
el mesmo auctor.
[620] G., generoso.
[621] G., y ansi.
[622] G., pereçieron.
[623] G., los.
[624] G., los miserables.
[625] G., los.
[626] G., la.
[627] G., corrupçion.
[628] G., siendo nuestro mas prinçipal mantenimiento solo pan de
çeuada o çenteno.
[629] G., del Emperador.
[630] G., la çiudad.
[631] G., y demandole que.
[632] G., se.
[633] G., respondieron.
[634] G., començose a murmurar de entre la gente que
acompañaua la justiçia.
[635] G., faltar.
[636] G., en mi honrra y satisfecho en mi justiçia y voluntad.
[637] G., deudor.
[638] G., de.
[639] G., por el.
[640] G., en.
[641] y como fuesse la risa de todos tan grande.
[642] G., Durango.
ARGUMENTO
DEL HONZENO
CANTO[643].

En el honzeno canto que se sigue


el auctor imitando a Luçiano
en el libro que intituló de Luctu
habla de la superfluidad y
vanidad que entre los
cristianos se vsa en la muerte,
entierro y sepoltura.
Descriuesse el entierro del
marques del Gasto, Capitan
general del Emperador en la
Ytalia; cosa de muy
de notar[644].

Miçilo.—Ya estoy, Gallo, a punto


aguardando para te oyr lo que me
prometiste en el canto passado:
por tanto comiença tú a dezir, y yo
a trabajar, y confia de mi atençion.
Gallo.—Por çierto no tengo yo,
Miçilo, menos voluntad de te
conplazer que tú de oyr; y ansi
porque tengamos tiempo para
todo vengamos a lo que me
demandaste ayer. Que me
pediste te dixesse como honbre
experimentado algo de la muerte,
pues por esperiençia tanto puedo
yo dezir; y ansi ante todas cosas
quiero que tengas por aueriguado
esta conclusion; que en la muerte
no ay qué temer.
Miçilo.—Pues ¿porqué la huyen
todos?
Gallo.—Porque toda cosa criada
se desea conseruar, y ansi
procura resistir su corruçion.
Miçilo.—¿Qué, no ay dolor en la
muerte?
Gallo.—No en verdad. Quiero
que lo veas claro, y para esto
quiero que sepas que no es otra
cosa muerte sino apartamiento
del anima y cuerpo: el qual se
haze en un breue punto, que es
como solemos dezir, en vn abrir y
çerrar de ojo. Avn es mucho
menos lo que llaman los
philosophos instante: lo qual tú no
puedes entender. Esto
presupuesto quiero te preguntar;
¿quándo piensas que la muerte
puede dar dolor? No dirás que le
da antes que el alma se aparte
del cuerpo; porque entonçes la
muerte no es; y lo que no es no
puede dar dolor. Pues tanpoco
creo que dirás que la muerte da
dolor despues de apartada el
alma del cuerpo; porque,
entonçes no ay subjeto que
pueda el dolor sentir; porque
entonçes el cuerpo muerto no
puede sentir dolor; ni el alma
apartada tiene ya porqué se doler.
Pues muy menos dirás que en
aquel punto que se aparta el alma
del cuerpo se causa el gran dolor;
porque en vn breue punto no se
puede causar tan terrible dolor, ni
se puede mucho sentir, ni mucho
puede penar. Quanto más que
esto que digo que es muerte, no
es otra cosa sino careçer del alma
que es la vida; y careçer (que los
philosophos llaman pribaçion) no
es cosa que tiene ser; es nada;
pues lo que nada es y no tiene
ser ¿cómo puede causar dolor?
Ansi que claro está si bien quieres
mirar, que la muerte no tiene qué
temer, pues solo se auia de temer
el dolor; el qual ves que no ay
quien le pueda entonçes causar; y
ansi de mí te sé dezir, como aquel
que habla bien por esperiençia,
que nunca la muerte me dio dolor;
ni nunca yo la sentí. Pero con
todo esto quiero que notes que ay
dos maneras de muerte: vna es
violenta; que estando sano y
bueno el hombre, por fuerça o
caso, o por violençia se la dan.
Como si por justiçia degollassen,
o ahorcassen vn honbre. Desta tal
muerte bien se podra dezir que el
que la padeçe sienta algun dolor;
porque como el paçiente está
sano y tenga todos los sentidos
sanos y enteros es ansi que al
passar del cuchillo por la
garganta, o al apretar de la soga
en aquel punto que sale el alma
por causa de la herida se le dé
pena; y no qualquiera pena, pero
la mayor que en esta vida vn
honbre pueda padeçer y sentir,
pues es tan grande que le
baste[645] matar. Pero ay otra
manera de muerte que llamamos
natural, la qual viene al honbre
por alguna larga enfermedad y
indispusiçion, o por la vltima
vejez. Esta tal çiertamente no da
dolor; porque como el enfermo se
va llegando a la muerte vansele
suçesiuamente entorpeçiendo los
sentidos y mortificandosele todos,
de manera que quando viene a
salirsele el alma ya no ay sentido
que pueda sentir la partida si
algun dolor vsasse[646] causar.
Que de otra manera ¿quien
dubda sino que el honbre haria al
tienpo del morir gestos, meneos y
visajes en que mostrasse
naturaleza que le diesse alguna
pena y dolor la muerte? Mas
antes has de tener[647] por
verdad, que ansi como en las
cosas que os perteneçen y
conuienen de parte de vuestra
naturaleza no se reçibe ninguna
pena ni trabajo al tienpo que las
effectuamos[648], mas antes todos
los animales nos holgamos y nos
plaze ponerlas en obra y exerçiçio
porque naturaleza nos dio
potençias y organos y
instrumentos conque sin
pesadunbre alguna las
pudiessemos exerçitar. Pues
desta mesma manera como la
muerte nos sea a todos los
honbres cosa natural, quiero
dezir, que los[649] conuiene de
parte de su[650] naturaleza;
porque todos los honbres y
animales nacieron mortales y[651],
no se les puede excusar, ansi
deues presumir, y avn creer, que
la muerte natural no solamente no
causa dolor, pero avn consuela y
reçibe el alma gran plazer en se
libertar y salir desta carçel del
cuerpo y yr a vibir mejor vida.
Porque la verdad este morir no es
acabar sino passar desta vida a
otra mejor, y de aqui viene a los
honbres todo su mal y dolor al
tiempo del morir, por careçer de fe
con que deuen creer que esto es
verdad. Porque aquellos
bienauenturados[652] martires que
con tanto regoçijo se ofreçian a la
muerte ¿de dónde piensas que

You might also like