Professional Documents
Culture Documents
Time-Frequency Composition of Mosquito Ight Tones Obtained Using Hilbert Spectral Analysis
Time-Frequency Composition of Mosquito Ight Tones Obtained Using Hilbert Spectral Analysis
Time-Frequency Composition of Mosquito Ight Tones Obtained Using Hilbert Spectral Analysis
net/publication/267043979
CITATIONS READS
4 265
4 authors, including:
Daniel Robert
University of Bristol
148 PUBLICATIONS 3,695 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
The role of acoustic signals in determining male mosquito mating success View project
All content following this page was uploaded by Daniel Robert on 23 June 2016.
[http://dx.doi.org/10.1121/1.4895689]
PACS number(s): 43.80.Ka, 43.60.Hj, 43.80.Ev [ANP] Pages: 1982–1989
1982 J. Acoust. Soc. Am. 136 (4), October 2014 0001-4966/2014/136(4)/1982/8/$30.00 C 2014 Acoustical Society of America
V
frequency spectrum for local sections of the data. When acquisition device, for duration of 60 s following the onset of
implemented in a spectrogram (the squared modulus of the consistent flight.
STFT), this technique allows for the reconstruction of the Laboratory temperatures were held between 24 C and
time evolution of the signal’s frequency content. 28 C for the duration of recordings. Lighting and humidity
However, one significant limitation of the STFT is that conditions were also monitored and controlled. Mosquitoes
it requires a trade-off between frequency resolution (the were used at the beginning of their night period, running on
scale at which nearby frequencies can be distinguished) and a D16:N8 circadian cycle. Each recording was taken in a
time resolution (the interval over which frequency changes sound-proof booth to minimize noise interference from
can be seen). Using a smaller window to partition the signal external sources.
allows for better resolution in the time domain but results in
a poorer frequency resolution. Similarly, a wider frequency B. Data output
bandwidth necessarily reduces temporal accuracy.
Spectrogram representations of the time-frequency plane are One example of the raw waveform of flight acoustics
often “blurred” as a result, and rendered unsuitable for the recorded from a single mosquito, prior to any processing, is
detection and analysis of rapid frequency modulations in displayed in Fig. 1. Variation in the flight tone amplitude is
bioacoustic signals (DiCecco et al., 2013), including mos- low, indicative of consistent and stable flight.
quito flight tones.
Besides the STFT, there are several alternative techni- III. FREQUENCY ANALYSIS METHODS
ques able to characterize the evolution of frequency in time. Resolving the frequency content of mosquito flight
Hilbert spectral analysis (HSA, Huang et al., 1998), which tones requires the isolation of harmonic components fol-
yields the instantaneous frequency of a signal, is a particu- lowed by frequency extraction. The algorithm presented here
larly useful example of such a method. The application of is based fundamentally on the notion of instantaneous fre-
HSA is especially effective in the context of mosquito flight quency, a concept which provides excellent resolution in the
tones, due to its utility in non-stationary systems that display time-frequency plane.
a highly variable frequency (Boashash, 1992). In this paper
we present a quantitative method for the extraction of fre- A. Instantaneous frequency
quency content from mosquito wing beat recordings, based
on HSA. Key features of our approach include automated The instantaneous frequency, xi ðtÞ, of a signal, xðtÞ,
identification of fundamental flight frequencies and har- derives from its Hilbert transform, HðxðtÞÞ. Following
monic overtones, application of time-varying filters to Huang et al. (1998, 2009), the general principle of HSA is as
reduce noise interference, and an algorithm to detect flight follows. We first take the Hilbert transform
cessation. This methodology achieves a significant improve- ð
1 1 xðsÞ
ment over previous studies in both the time and frequency ð ð Þ Þ ð
H x t ¼y t ¼ PÞ ds; (1)
resolution of mosquito flight tones. p 1 t s
J. Acoust. Soc. Am., Vol. 136, No. 4, October 2014 Aldersley et al.: Frequency analysis of mosquito flight tones 1983
useful trait when handling experimentally derived acoustic amplitude component in every case (Fig. 2). The prominence
signals displaying non-stationary behaviors, as with mos- of this harmonic in the flight tones that we have recorded
quito flight tones. Under this definition, HðxðtÞÞ yields the lends it well to application in the remainder of the algorithm.
imaginary part of the analytic pair, yðtÞ, of the real data, xðtÞ, Isolation of the fundamental and harmonic overtones
so that we have a unique analytic signal given by from the main body of the signal is facilitated by the applica-
tion of a bandpass filter, which is defined by a center-
zðtÞ ¼ xðtÞ þ jyðtÞ ¼ ai ðtÞejhi ðtÞ ; (2) frequency and bandwidth. We take an automated approach
to the specification and design of these filter parameters (see
where ai ðtÞ and hi ðtÞ describe, respectively, the instantane-
pffiffiffiffiffiffiffi Fig. 3). The first step is to approximate the distribution of
ous amplitude and phase associated with xðtÞ, and j ¼ 1. the Fourier spectrum about the chosen frequency component.
The instantaneous frequency is then defined as the time de- The spectrum is normalized by dividing through by its stand-
rivative of hi ðtÞ; ard deviation (this improves function fitting). We then fit ei-
ther a skew Gaussian or a skew Laplace distribution to the
dhi
x i ðt Þ ¼ : (3) data; the choice of function is made by considering the kur-
dt tosis of the spectrum about the given frequency peak. We
Note that because hi is a function of time, so too is xi . find that data with a kurtosis 10 are best approximated by
the skew Gaussian, whereas the skew Laplacian consistently
fits data with a kurtosis >10.
B. Isolating harmonic frequencies
The fitting procedure and subsequent filter parameter
The notion of an instantaneous frequency is only mean- estimation is equivalent whichever distribution is used. The
ingful when applied to mono-component functions scale and location parameters of the fitting function are opti-
(Boashash, 1992), that is, data with a narrow bandwidth mized to the data using a least squares approach, recursively
(Huang et al., 1998). For multi-component signals, such as tuning values to minimize error. The peak of the distribution
the acoustic tones generated by mosquito flight, we must identifies the center point of the transfer function for the fil-
therefore filter each of the harmonic frequencies prior to ter. The bandwidth (i.e., the upper and lower cutoff frequen-
HSA. We have developed an automated procedure based on cies) is obtained using the frequencies at full-width, fraction
peak-frequency estimation that allows us to identify and iso- p% maximum of the fitted distribution (we typically choose
late the various harmonic frequency components contained p ¼ 2% for a Gaussian fit, and p ¼ 5% for a Laplacian).
within the sound profile of mosquito flight. The approach con- This process is outlined graphically in Fig. 3. The resultant
sists of several stages, described below. linear filter is subsequently applied to the audio recording.
Given a raw acoustic recording, an initial estimation of The temporal dynamics of mosquito flight frequencies
its frequency content is performed using Discrete Fourier are inherently non-stationary. With this in mind, an addi-
analysis. The signal is high-pass filtered (using a 4 order tional layer of sophistication must be introduced to our filter
Butterworth filter) to remove low-frequency components process to ensure that it robustly captures wing beat fre-
(300 Hz), which can cause noise interference, prior to quency information. In particular, a simple static filter
Fourier transformation. From the resultant Fourier spectrum applied to an entire recording can lead to a sub-optimal fre-
we identify the peak corresponding to the mosquito’s funda- quency response and, for instance, an increase in the noisi-
mental wing beat frequency, which we find to be the largest ness of the resultant instantaneous frequency functions (see
Fig. 4). One way to address this problem is to instead
1984 J. Acoust. Soc. Am., Vol. 136, No. 4, October 2014 Aldersley et al.: Frequency analysis of mosquito flight tones
comprised of the harmonic frequencies up to and including
the male second and female third overtones; convergent
behaviors are observed to take place at or below these fre-
quencies (Cator et al., 2009).
J. Acoust. Soc. Am., Vol. 136, No. 4, October 2014 Aldersley et al.: Frequency analysis of mosquito flight tones 1985
FIG. 6. Comparing a spectrogram-based frequency representation (gray) of
an individual male mosquito’s flight tone to that of the instantaneous fre-
quency (black) demonstrates superior resolution in the time and frequency
domains for the latter approach. Rapid frequency modulations are captured
in excellent detail, providing a much clearer visualization of local mosquito
wing beat frequency behaviors. Note that the time-axis is extended either
side of the instantaneous frequency data merely to enable adequate presenta-
tion and comparison to the spectrogram image.
1986 J. Acoust. Soc. Am., Vol. 136, No. 4, October 2014 Aldersley et al.: Frequency analysis of mosquito flight tones
“global” statistics to be somewhat diminished. To illustrate
any potential differences between male and female flight
characteristics it may be more informative to partition the
data into smaller, approximately-stationary subsets. Using
the fundamental flight component, we determine the array
( )
j xi l j ðsÞ
yi ¼ (4)
j ðsÞ
l
i¼1;…;n
J. Acoust. Soc. Am., Vol. 136, No. 4, October 2014 Aldersley et al.: Frequency analysis of mosquito flight tones 1987
us to explore further the nature of frequency as a property of
flight.
We recorded the flight tones of tethered lone male and
female A. aegypti mosquitoes for a duration up to 60 s. Male
and female wing beat frequencies obtained via HSA are stat-
istically consistent with those reported elsewhere for this
species, both in terms of global mean flight frequency and its
spread across individuals (G€opfert et al., 1999; Cator et al.,
2009; Arthur et al., 2014), indicating that our method does
indeed accurately capture the true frequency content of the
mosquito flight trace. Furthermore, by partitioning the data
into smaller short-time subsets, we have been able to account
for the inherent non-stationarity of mosquito flight. Our find-
ings reveal that wing beat frequencies are normally distrib-
uted about a local mean value. Male mosquitoes, however, FIG. 9. (Color online) When positioned close together (around 2 cm apart),
tend to deviate more from this mean than their female male and female Aedes aegypti display convergence of their flight tones.
This behavior commonly takes place at the male 2 and female 3 harmonic
conspecifics.
frequency components. When viewed using a spectrogram, resolution is
The significance of this qualitative difference between coarse and it is difficult to accurately prescribe signal ownership. Using the
male and female flight tone characteristics is unclear, yet instantaneous frequency representation of flight tone, resolution in the time-
analyses of pairwise mosquito interactions point to wing beat frequency plane is significantly enhanced. Recording mosquitoes on sepa-
rate channels also allows us to assign the male (M) and female (F) flight
frequency as a critical factor in species and gender identifica- tones with precision. As in Fig. 6, the time-axis displays both the spectro-
tion (Gibson and Russell, 2006; Cator et al., 2009; Warren gram alone (0–30 s), and the spectrogram overlaid with the instantaneous
et al., 2009; Pennetier et al., 2010), as well as in sexual selec- frequencies of each mosquito (30–60 s). This allows thorough inspection
tion (Cator et al., 2010; Cator and Harrington, 2011). Despite and clear comparison between the two methods.
this, there is a lack of quantitative investigation in this field,
and consequently the ubiquity and accuracy of the described assigned to particular individuals using spectrogram analy-
phenomena remain uncertain. For instance, during harmonic sis. Our method is able to unambiguously ascribe a given
convergence (Cator et al., 2009) between males and females, xi ðtÞ function to its producer (Fig. 9).
how close do their flight tones have to be to result in a suc- The study of acoustic communication between mosqui-
cessful duet? And what information do the more detailed and toes, and its broader role in reproductive processes, is central
dynamic properties of wing beat signals, such as high- to our understanding of their behavioral ecology. It is hoped
frequency tonal modulations and local variance, convey to that the analysis presented here will stimulate further investi-
other individuals? In order to answer these questions, and gations into the nature of frequency-based interactions
thus more comprehensively investigate interactions between between these insects.
mosquitoes, a detailed realization of frequency as a time- The characterization of nonlinear and non-stationary
dependent property is required. bioacoustic signals using HSA has arguably been underutil-
Arthur et al. (2014) recently presented two tools to sepa- ized in the literature. Exceptions include the study of whale
rate simultaneous flight tones during convergence behavior. clicks (Adam, 2006) and bat echolocation calls (DiCecco
The first of these is based on the phase-derivative of spectral et al., 2013). One possible reason for this under-utilization is
maxima in the spectrogram, while the second uses polyspec- that one has to first isolate a narrow band around the fre-
tra to enhance time-frequency resolution. Despite offering quency of interest in the signal before applying the Hilbert
greater accuracy than the coarsely represented spectrogram, transform. The central frequency and width of the band is
these approaches are still inherently limited by similar fac- likely to vary from species to species and between individu-
tors. By taking an instantaneous frequency approach to the als of the same species. Thus, unlike the STFT there has,
extraction of mosquito flight tone data, we have demon- until now, been no black-box method that can be easily
strated a far superior clarity in time and frequency compared applied to different biological systems. In this work, we
to any method used to date in the mosquito bioacoustics lit- have shown how to construct a highly optimized tool for the
erature. As illustrated in Fig. 9, convergence of flight tones extraction of frequency content contained within mosquito
now has the potential to be studied in much greater quantita- flight tones. In principle this same methodology can be
tive depth, owing to the quality of data available. adapted to work for many other bioacoustic communication
Experimentally, resolution of nearby harmonic frequencies studies involving non-stationary harmonic functions.
from different mosquitoes can be achieved by recording
each individual on a separate digital channel. This is in con- ACKNOWLEDGMENTS
trast to previous research, which has tended to log the duet This work was funded by the Engineering and Physical
on a single microphone positioned equidistant from each Sciences Research Council (EPSRC), Grant No. EP/
mosquito (Gibson and Russell, 2006; Cator et al., 2009; E501214/1. D.R. is supported by the Royal Society London.
Warren et al., 2009; Pennetier et al., 2010). In these studies
it is somewhat unclear how overlapping signals from unique Adam, O. (2006). “Advantages of the Hilbert Huang transform for marine
sources (observed during harmonic convergence) were mammals signals analysis,” J. Acoust. Soc. Am. 120(5), 2965–2973.
1988 J. Acoust. Soc. Am., Vol. 136, No. 4, October 2014 Aldersley et al.: Frequency analysis of mosquito flight tones
Alphey, L., Benedict, M., Bellini, R., Clark, G. G., Dame, D. A., Service, M. W., G€opfert, M. C., Briegel, H., and Robert, D. (1999). “Mosquito hearing:
and Dobson, S. L. (2010). “Sterile-insect methods for control of mosquito- Sound-induced antennal vibrations in male and female Aedes aegypti,”
borne diseases: An analysis,” Vector-borne Zoonot. 10(3), 295–311. J. Exp. Biol. 202 (part 20), 2727–2738.
Arthur, B. J., Emr, K. S., Wyttenbach, R. A., and Hoy, R. R. (2014). Howell, P., and Knols, B. G. J. (2009). “Male mating behaviour,” Malaria J.
“Mosquito (Aedes aegypti) flight tones: Frequency, harmonicity, spherical 8(Suppl. 2), S8.
spreading, and phase relationships,” J. Acoust. Soc. Am. 135(2), 933–941. Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Shih, H. H., Zheng, Q.,
Belton, P. (1994). “Attraction of male mosquitoes to sound,” J. Am. Mosq. Yen, N.-C., Tung, C. C., and Liu, H. H. (1998). “The empirical mode
Control Assoc. 10(2), 297–301. decomposition and the Hilbert spectrum for nonlinear and non-stationary
Boashash, B. (1992). “Estimating and interpreting the instantaneous fre- time series analysis,” Proc. R. Soc. London, Ser. A 454(1971), 903–995.
quency of a signal. I. Fundamentals,” Proc. IEEE 80(4), 520–538. Huang, N. E., Wu, Z., Long, S. R., Arnold, K. C., Chen, X., and Blank, K.
Cator, L. J., Arthur, B. J., Harrington, L. C., and Hoy, R. R. (2009). (2009). “On instantaneous frequency,” Adv. Adapt. Data Anal. 1(2),
“Harmonic convergence in the love songs of the dengue vector mosquito,” 177–229.
Science 323(5917), 1077–1079. Jackson, J. C., and Robert, D. (2006). “Nonlinear auditory mechanism
Cator, L. J., and Harrington, L. C. (2011). “The harmonic convergence of enhances female sounds for male mosquitoes,” Proc. Natl. Acad. Sci.
fathers predicts the mating success of sons in Aedes aegypti,” Anim. U.S.A. 103(45), 16734–16739.
Behav. 82, 627–633. Jackson, J. C., Windmill, J. F. C., Pook, V. G., and Robert, D. (2009).
Cator, L. J., Ng’Habi, K. R., Hoy, R. R., and Harrington, L. C. (2010). “Synchrony through twice-frequency forcing for sensitive and selective au-
“Sizing up a mate: Variation in production and response to acoustic sig- ditory processing,” Proc. Natl. Acad. Sci. U.S.A. 106(25), 10177–10182.
nals in Anopheles gambiae,” Behav. Ecol. 21(5), 1033–1039. Johnston, C. (1855). “Original communications: Auditory apparatus of the
Charlwood, J. D., Pinto, J., Sousa, C. A., Madsen, H., Ferreira, C., and Do Culex mosquito,” Q. J. Microsc. Sci. 1(10), 97–102.
Rosario, V. E. (2002). “The swarming and mating behaviour of Anopheles Pennetier, C., Warren, B., Dabire, K. R., Russell, I. J., and Gibson, G.
gambiae s.s. (Diptera: Culicidae) from S~ao Tome Island,” J. Vector Ecol. (2010). “ ‘Singing on the wing’ as a mechanism for species recognition in
27(2), 178–183. the malarial mosquito Anopheles gambiae,” Curr. Biol. 20(2), 131–136.
Clements, A. N. (1999). “Flight performance in the laboratory,” in The Roth, L. M. (1948). “A study of mosquito behavior. An experimental labora-
Biology of Mosquitoes, Volume 2: Sensory Reception and Behaviour tory study of the sexual behavior of Aedes aegypti (Linnaeus),” Am. Midl.
(Chapman & Hall, London), Chap. 33, pp. 292–298. Nat. 40(2), 265–352.
DiCecco, J., Gaudette, J. E., and Simmons, J. A. (2013). “Multi-component Warren, B., Gibson, G., and Russell, I. R. (2009). “Sex recognition through
separation and analysis of bat echolocation calls,” J. Acoust. Soc. Am. midflight mating duets in Culex mosquitoes is mediated by acoustic dis-
133(1), 538–546. tortion,” Curr. Biol. 19(9), 485–491.
Gibson, G., and Russell, I. R. (2006). “Flying in tune: Sexual recognition in Wishart, G., and Riordan, C. F. (1959). “Flight responses to various sounds
mosquitoes,” Curr. Biol. 16(13), 1311–1316. by adult males of Aedes aegypti,” Can. Entomol. 91(3), 181–191.
J. Acoust. Soc. Am., Vol. 136, No. 4, October 2014 Aldersley et al.: Frequency analysis of mosquito flight tones 1989