Professional Documents
Culture Documents
Quantum BP Neural Network For Speech Enhancement: Fei Li Guobiao Xu
Quantum BP Neural Network For Speech Enhancement: Fei Li Guobiao Xu
Fei Li Guobiao Xu
Institue of Signal Processing and Transmission Network Maintenance Division ofHuai'an Branch
Nanjing University of Posts and Telecommunications Jiangsu Mobile Communications Corporation
Nanjing, China Huai'an, China
e-mail: lifei@njupt.edu.cn e-mail: xuguobia0397@163.com
Abstract-Quantum Neural Network (QNN), a burgeoning give us some advantages unattainable by classical artificial NN
new field which integrates quantum computation with classical such as exponential memory capacity, higher performance for
neural network, can improve the inadequacies of artificial neural lower number of hidden neurons, faster learning, etc [6]. These
network. A model of quantum neuron and Quantum Back potential advantages of QNN are indeed compelling motivation
Propagation (BP) Neural Network based on quantum neuron are
investigated. A novel approach toward speech enhancement
for their development. Some authors proposed the approach
which adopts Quantum BP Neural Network is proposed. The toward speech signal processing which adopts QNN [7-8].
numerical simulation results show that the proposed speech In this paper, a novel speech enhancement algorithm based
enhancement scheme resulted in better performance than
on Quantum BP Neural Network is proposed and its
traditional spectral subtraction, Wiener filtering method and
RBF neural network.
performance is evaluated. The rest of this paper is organized as:
In Section II we shortly review the basic notations of quantum
Keywords-Quantum Computation; Quantum Neural Network; computing. In Section III we describe the mechanism of
Back Propagation; Speech Enhancement quantum neuron and Quantum BP Neural Network. In Section
IV the proposed speech enhancement based on Quantum BP
I. INTRODUCTION Neural Network is introduced and the numerical simulation
There are many speech enhancement algorithms, such as results are discussed. Finally, we give conclusions in Section V.
wavelet decomposition, spectral subtraction, Wiener filtering
II. FOUNDATION OF QUANTUM COMPUTING
and neural network (NN), etc. Speech enhancement based on
neural network is one of research hotspots within current A. Quantum Bit
speech enhancement domain [1]. The smallest unit of information stored in a two-state
Neural Network has some attractive features such as large- quantum computer is called a quantum bit or qubit. A qubit is a
scale parallel processing, fault tolerance, self-organization, self- unit vector in the two-dimensional Hilbert complex vector
adjustment and association, etc [2]. However, NN also faces space for which a particular basis, denoted by {IO>,/l>}, has
many difficulties including the absence of rules for determining been fixed. The orthonormal basis {IO>,ll>} can be expressed
optimal architectures, limited memory capacity, time- as {(I, O)T, (0, I)T}. For the purposes of quantum computation,
consuming training, catastrophic forgetting due to the pattern the basis states 10> and 11> are taken to represent the classical
interference etc. bit values 0 and 1 respectively. Unlike the classical bit however,
a qubit can be in a superposition of 10> and 11> such as [9]:
In the field of NN, some pioneers introduced quantum
computation into analogous discussion such as quantum neural (1)
computing, quantum-inspired neural network and quantum
associative memory [3-5]. They constructed the foundation for where a and b are complex numbers called probability
further study of quantum computation in NN. From this amplitude. That is, if such a superposition is measured with
scenario, emerge the field of neural network based on quantum respect to the basis {IO>,11>}, the probability that the measured
theoretical concepts and techniques. They are called Quantum value is 10> is lal 2 and the probability that the measured value is
2
Neural Network (QNN). 11> is Ib1 , and
Quantum neural network (QNN) is a burgeoning new field (2)
which integrates classical NN with quantum computing. It can
be justified both by the potential of combining their benefits
and also to eliminate some their inherent shortcomings. QNN
Unlike the classical digital logical gates, the quantum gates A. Quantun Neuron
generally act on a superposition of digital states such as (1). Quantum neuron can be composed of quantum gates, as in
Through the single bit rotation gate as shown in Fig. 1, the state Fig.3. The two basal quantum logical gates are included in this
of one qubit is rotated to B angle. The two-bit controlled NOT quantum neuron model and complete the complex operation of
gate performs XOR operation, as in Fig.2. It follows that if the input quantum state. The connection between the neuron
quantum bit ' a' is 10>, quantum bit ' b' is output keeping its states and the quantum states is made as follows: firing neuron
input, while if quantum bit 'a' is 11>, quantum bit 'b ' is state is defined as qubit state II>, non-firing neuron state is
reversed (through NOT operation) its input state and then defined as qubit state 10>, and the arbitrary neuron state is the
output. coherent superposition of the two.
- 0 1---
Figure I. One-bit Rotation Gate
a
1-----'<----1 o
b + l---- a ffi b
Figure 3. Quantum Neuron Model
390
spectral subtraction based speech enhancement, the improved
wiener filter based speech enhancement, RBF neural network
based speech enhancement and our Quantum BP Neural
Network based speech enhancement. We evaluate speech by
measuring Mel Cepstral Distance (MCD) Distortion [12]. The
experiment results are given in Table 1.
According to the experiment results, Mel Cepstral
Distance of enhanced speech, which are largely improved
compared with the former ones, are very small. The Mel
Cepstral Distance of enhanced speech by Quantum BP
Neural Network is the smallest, which means the proposed
Quantum BP Neural Network based speech enhancement
outperforms the others.
15
4
X 10
Spectral Subtraction
Figure 5. Speech Enhancement Based On Quantum BP Neural Network
.,
"0
~
Experiments have been conducted on ' 863 Speech C.
E
Database' collected by the Center for Speech Signal Processing '"
of NUPT. The pure speech signal was randomly divided into t X 104 X
4
10
two sets which length are respectively about five minutes. One RBF Network Quantum BP Network
set is used for training the network and another is used for
evaluation.
B. Experiment results
Novel experiments have been designed for in depth studies
of applying the Quantum BP Neural Network to speech Figure 6. Time-domain graphs
enhancement. The speech signals are generated by adding
mixed noises (including: white noise, pink noise, brown noise,
high frequency channel noise, etc.) into pure speech.
For comparison, evaluations were also done for classical
NN and other methods. We report the experiments of the
391
Noisy Speech Signal(SNR=3 .7698dB)
», 1 r----~-~----, R EFERENCES
g
s 0.5 [I] Parveen, Shahla; Green, Phil. "Speech enhancement with missing data
techniques using recurrent neural networks", Proceedings - IEEE
~ a r~~!l!glle~!!~
u, i::l ' """ International Conference on Acoustics, Speech, and Signal Processing,
4 6
4
May 17,2004 - May 21,2004 .
X 10 Time x 104
Spectral Subtraction lmproeed Wiener Filter [2) Ding Shifei; Su Chunyang; Zhang Liwen, etal. "Neural network research
», », progress and applications in forecast", Lecture Notes in Computer
g g Science v 5264 LNCS, n PART 2, pp.783-793, 2008, Advances in
~ 0.5 s.,. .
0.5 , '
Neural Networks - ISNN 2008 - 5th International Symposium on Neural
~ . . . .~. . .IIlii_ _1II ~
u. 0- u, Networks, ISNN 2008, Proceedings .
24 6
Time x 104 4 [3) S.Kak, "On Quantum Neural Computing ", Information Science, Vo1.83.
X 10
RBF Network Quantum BP Network
pp.I43-I60,I995.
[4] T. Menneer and A. Narayanan , "Quantum-inspired Neural Networks ",
Tech. Rep. R329. Univ. of Exeter, 1995.
[5] D. Ventura and T. R. Martinez, "Quantum Associativ e Memory",
4 6 4 6 Information Sciences, Vo1.I24. pp.273-296 , 2000.
Time 4
10
Time 4
10 [6] A. Ezhov and D.Venture, "Quantum Neural Networks", In: Kasabov N.
------
X X
(ed.): Future Directions for Intelligent Systems and Information Sciences .
Figure 7. Spectrum maps 2000, pp. 213-234 .
[7) LI Fei , ZHAO Shengrnei , ZHENG Baoyu. "Quantum Neural
V. CONCLUSION Network in Speech Recognition", IEEE 2002 6th International
Conference on Signal Processing Proceedings (ICSP02), Beijing, China,
In this paper we have proposed a novel speech Aug. 2002, pp.I267-1270.
enhancement scheme based on Quantum BP Neural Network, [8] Laxmidhar Behera and Bharat Sundaram, "Stochastic Filtering and
which combines the advantages of quantum computing and Speech Enhancement using a Recurrent Quantum Neural Network ",
feed-forward neural network. An analysis is given to the ICISIP 2004, pp.I65-I 70
theoretical basis and practical performance of the proposed [9] Nielsen M A. Chuang I L. "Quantum Computation and Quantum
Information", Cambridge University Press, 2000.
speech enhancement scheme. The comparison experiments
[10] DiVincenzo D., "Two-Bit Gates are Universal for Quantum
results show that the new scheme has better denoising effect Computation ", Phys. Rev. A. Vo!.5I , 1995, pp.1015-1022.
and robustness than traditional spectral subtraction, Wiener [II] Nobuyuki Matsui, Nobuyuki Kouda, Haruhiko Nishimura,eta!. "Neural
filtering method and RBF neural network. Network Based on QBP and Its Performance", Neural
Networks,Vo!.7(3), 2000, pp.247-252.
ACKNOWLEDGMENT [12] Kubichek, Robert F. "Mel-Cepstral distance measure for objective
This work was supported in part by the National Research speech quality assessment", IEEE Pac Rim Conf Commun. Comput.
Signal Process, 1993, pp.125-128.
Foundation for the Doctoral Program of the Ministry of
Education of China under Grant No. 2006029300 I.
392