Professional Documents
Culture Documents
An Adaptive Deep Learning Model To Differentiate Syndromes Ofinfectious Fever in Smart Medicine
An Adaptive Deep Learning Model To Differentiate Syndromes Ofinfectious Fever in Smart Medicine
Zhuo Liu, Changchuan Bai, Hang Yu, Ying Zhu, Taihua Wu, Fanyu Bu
PII: S0167-739X(19)32184-3
DOI: https://doi.org/10.1016/j.future.2019.09.055
Reference: FUTURE 5221
Please cite this article as: Z. Liu, C. Bai, H. Yu et al., An adaptive deep learning model to
differentiate syndromes of infectious fever in smart medicine, Future Generation Computer
Systems (2019), doi: https://doi.org/10.1016/j.future.2019.09.055.
This is a PDF file of an article that has undergone enhancements after acceptance, such as the
addition of a cover page and metadata, and formatting for readability, but it is not yet the definitive
version of record. This version will undergo additional copyediting, typesetting and review before it
is published in its final form, but we are providing this version to give early visibility of the article.
Please note that, during the production process, errors may be discovered which could affect the
content, and all legal disclaimers that apply to the journal pertain.
of
b
Dalian Hospital of Traditional Chinese Medicine, Dalian, China.
c
Department of Computer Science, St. Francis Xavier University, Antigonish, B2G 2W5, Canada.
d
College of Computer and Information Management, Inner Mongolia University of Finance and Economics, Hohhot,
China.
pro
Abstract
Recently, smart medicine has been considered as a promising technique to treat the intractable
diseases by combining deep learning techniques with medical Internet of Things. As an important
re-
component in the integration of traditional and western medicine, smart medicine is particularly
effective to treat infectious fever. Before the cause of infectious fever diseases is ascertained, the
Chinese medicine intervention is able to alleviating symptoms and strive for time for the causes
detection. However, accurate syndrome differentiation, a difficult issue in infectious fever, is the
premise of the Chinese medicine intervention. This work presents a possible adaptive deep learn-
lP
ing model by integrating an adaptive dropout function into the stacked auto-encoder for computer-
aided syndrome differentiation in infective fever. Moreover, we summarize the main syndromes
and prescriptions in infectious fever. This work is expected to further the development of smart
medicine, especially smart Chinese medicine. More importantly, it points out a novel research
direction and medical technique in the treatment of infectious fever in clinic.
Keywords: Smart medicine, Medical Internet of Things, Deep learning, Infectious fever
a
urn
of
coplasma, chlamydia, rickettsia, spirochetes, origin. In particular, during the examination
and malaria [11]. In particular, the fever may of pathogens, the traditional Chinese medicine
occur in the acute or chronic, localized or sys- can be used to alleviate symptoms by bring-
ing down the fever. Therefore, the Chinese
pro
temic infection. From the point of view of
pathogenesis, the metabolites of pathogenic medicine is playing an important role in treat-
microorganisms or their toxins act on white ing the infectious fever, especially the fever of
blood cells to produce and release endogenous unknown origin, in the integration of tradition-
heat sources. Their molecular weight is so s- al Chinese medicine and western medicine.
mall that they can directly act on the body tem- The theory of traditional Chinese medicine
perature regulation center through the blood- states that the toxin is caused by fever. Based
re-
brain barrier. In this case, the temperature reg- on a large volume of clinic experience, we
ulation point is raised, thus causing fever. In- put forward a new theory of infectious fever,
fectious fever is seriously threatening human which states that fever is caused by toxin. In
health. For example, during the past few years, detail, the pathogenesis of the fever comes
a large number of enterococci which can re- from four respects. Firstly, the invasion of cold
lP
sist carbon, hydrogen, enzymes, and alkene causes the occlusion of Xuanfu, and thus lead-
have emerged since the abuse of antibiotics ing to fever. Secondly, the external toxin is
such as mepem and imiperem destroys the mi- latent in the body and then produces the fever.
croecological balance in the intestine [12,13]. Thirdly, toxin fever is caused by implication of
In particular, the infection of the enterococ- evil Qi and plague. Finally, the fever is caused
ci may cause septicemia when the enterococ- by internal toxin. Furthermore, we put forward
a
ci enters the blood. Moreover, the enterococ- a new theory for syndrome differentiation and
ci often leads to sepsis when it infects two or treatment for infectious fever, the location by
urn
more human organs. Antagonism is the main three cardinal guides and zang-fu viscera, the
method of Western medicine in treating in- qualitative analysis by two-izations and qi and
fectious fever. For example, tigecycline and blood, and the tendency determining by four
polymyxin are usually used to treat the infec- stages with deficiency and excess. In detail,
tion of the enterococci [14,15]. However, they three cardinal guides includes exterior, interi-
are not always effective. In this case, the infec- or, and smi-exterior-interior, and zang-fu vis-
tion of the enterococci will result in the death. cera include heart and small intestine, lung and
Jo
The speed of research and development of new large intestine, spleen and stomach, liver and
effective antibiotics is far behind that of bac- gallbladder, kidney and bladder, and pericardi-
terial mutation. When no effective antibiotics um by heat and sanjiao. Two-izations include
can be developed to treat the infection of mu- cold and heat, and qi and blood states the qifen
tant bacteria, human life is seriously threat- and xuefen differentiation of infectious fever.
ened. In this case, the intervention of tradition- Four stages include latent stage, early stage,
2
Journal Pre-proof
obvious stage of symptoms, and termination fectious fever in the traditional Chinese
stage. Moreover, each stage is divided into d- medicine. The presented theory is three-
eficiency syndrome and excess syndrome. By fold: (1) fever being caused by toxin; (2)
this theory, the Chinese medicine aims to coor- the location by three cardinal guides and
dinate yin and yang. For example, the Chinese zang-fu viscera, the qualitative analysis
medicine restores ecological balance in intes- by two-izations and qi and blood, and the
tine by coordination yin and yang for treating tendency determining by four stages with
of
the invasion of enterococci. By the compre- deficiency and excess; (3) four therapeu-
hensive application of Treatise on Epidemic tic methods of sweating, dispersing, purg-
Febrile Diseases and Treatise on Febrile Dis- ing, and preventing for treating infectious
eases, we put forward four therapeutic meth- fever.
pro
ods of sweating, dispersing, purging, and pre-
venting for bringing down the fever • We present a promising deep learning
Syndrome differentiation is the premise and model that integrates an adaptive func-
core of the Chinese medicine [18] for treating tion into the stacked auto-encoder for au-
the infectious fever. However, it is hard for the tomatical computer-aided syndrome dif-
traditional Chinese medicine to accurately dif- ferentiation of infectious fever.
re-
ferentiate the syndromes of the infectious fever • We summarize the main syndromes of in-
because of the complexity of the infectious fectious fever by two methods of syn-
fever. On the one hand, the infectious fever drome differentiation that are sanjiao syn-
has many different syndromes. On the oth- drome differentiation and syndrome d-
er one hand, some different syndromes have ifferentiation by weifen, qifen, yingfen,
lP
present a promising deep learning model by el. The main syndromes of infectious fever are
combining an adaptive dropout function with summarized in Section 4 and the future work
urn
is expected to further the development of the combining data mining, machine learning,
smart Chinese medicine. cloud computing, and medical Internet of
Overall, the paper has three contributions: Things with the theory of the traditional Chi-
nese medicine. In particular, data mining and
• We put forward a new theory for syn- machine learning are used to mine and sum-
drome differentiation and treatment of in- marize the successful clinic experience of a
3
Journal Pre-proof
large number of experts in traditional Chinese layer is responsible for uploading the patien-
medicine. Once the clinic experience is mod- t’s symptoms to the cloud layer. Most algo-
eled and parameterized, the young or unex- rithms and models are implemented on cloud
perienced doctors of the traditional Chinese for syndrome differentiation and prescription
medicine can be helped with syndrome differ- recommendation or re-organization. In addi-
entiation and prescription recommendation, e- tion, the main companied symptoms are rec-
specially for the difficult and complicated dis- ognized and the prescription re-organization is
of
eases. Moreover, smart Chinese medicine pro- also implemented on cloud.
vides a bridge for the treatment of complex From the framework, syndrome differentia-
diseases by the integration of traditional Chi- tion is the fundamental step for implementing
nese medicine with western medicine. In par- the smart Chinese medicine. In particular, a
pro
ticular, with the smart Chinese medicine plat- stacked auto-encoder was presented for poten-
form, the doctors without the experience in the tial syndrome differentiation of hypertension
traditional Chinese medicine can differentiate which is a common disease all over the world.
the syndromes and write a prescription by the The stacked auto-encoder is composed of two
theory of the traditional Chinese medicine. hidden layers, as shown in Figure 2 [9].
Zhang et al. [8] presented a unified smart
re-
Chinese medicine framework for computer-
aided syndrome differentiation and prescrip-
tion recommendation based on the edge-cloud
platform, as shown in Figure 1.
a lP
work.
of
tion of spleen-stomach diseases, shown in Fig-
ure 4 and Figure 5.
Figure 3: Example of an auto-encoder.
pro
Furthermore, the authors summarized the
main symptoms and the companied symptom-
s of each syndrome of hypertension. Overal-
l, the primary symptoms of hypertension are
vertigo and headache. In detail, five common
re-
syndromes of hypertension are the stagnation
of liver qi with the primary symptoms, liv-
er fire flaring up with the primary symptom-
s and dysphoria, upper hyperactivity of liv-
er yang with the primary symptoms and two
lP
main symptoms of soreness and weakness of Figure 4: Example of a multi-modal deep learning mod-
el.
waist and knees and dysphoria with feverish
sensation in chest, palms and soles, deficien-
cy of yin and yang with the primary symptoms
and fear of cold and cold limbs, and abundant
phlegm-dampness with the primary symptom-
a
of
drome differentiation of infectious fever by cally decreasing and its values are also in (0,1).
integrating an adaptive dropout function into This function has been proved to be effective
the stacked auto-encoder. The stacked auto- to reduce the over-fitting of the deep compu-
encoder is a promising model for syndrome tation model. More importantly, the adaptive
pro
differentiation in smart Chinese medicine. dropout deep computation model based on this
However, it often produces the over-fitting distribution function has achieved a high clas-
when it is used for classification in complex sification accuracy in some experiments.
tasks. Aiming at this issue, Hinton et al. [20] Therefore, we integrate the distribution
proposed a dropout model by setting the acti- function into the stacked auto-encoder to
vation rate of each neuron in the hidden layer- present an adaptive dropout stacked auto-
re-
s to 0.5. Although the dropout model could encoder which can be viewed as a special
reduce the over-fitting of the stacked auto- case of the adaptive dropout deep computa-
encoder, it cannot always obtain the desirable tion model. Figure 6 shows an example of the
classification results since it always setts the dropout stacked auto-encoder.
same activation rate in each hidden layer. To
lP
y{ = f (l) =
−0.1l + 0.05n + 0.5 n = 2k(k = 1, 2, ...) ,
−0.1l + 0.05n + 0.55 n = 2k − 1(k = 1, 2, ...)
(3)
where n is the total number of layers. Clearly,
the distribution function is monotonically de-
creasing and its values are always in (0,1).
Jo
of
1 y = f (l);
2 for trainingobject = 1, 2, ..., M do
Figure 7: The l-th hidden layer in adaptive dropout deep
3 for j = 1, 2, 3, ...m do
computation model.
pro
4 Use Eq.(1) to compute hi ;
5 Use Eq.(4) to compute y;
The parameters of each layer in the adaptive
6 mark{i} = rand(size(h) > y);
dropout stacked auto-encoder are trained by
7 h = h · ∗mark{i};
the adaptive back-propagation algorithm de-
8 for i = 1, 2, 3, ..., n do
scribed in Algorithm 1.
9 Use Eq.(2) to compute yi ;
In the adaptive back-propagation algorithm,
re-
the output of each hidden and output neuron 10 if J(θ) > threshold then
is computed on line 3-9, and the partial deriva- 11 for i = 1, 2, 3, ..., n do
(3)
tives are computed by the back-propagation al- 12 Compute σi [ ];
gorithm on lines 11-23. Finally, the parameter- 13 for j = 1, 2, 3, ...m do
s are updated by the gradient descent method (2)
Compute σj [13];
lP
14
on lines 25-26.
15 σ (2) = σ (2) ·
∗[ones(size(σ (2) , 1), 1)mark{i}];
4. Common Syndromes of Infectious Fever
16 for i = 1, 2, 3, ..., n do
(2) (2) (3)
In this paper, we summarize the common 17 ∆bi = ∆bi + σi ;
syndromes of the infectious fever by the syn- 18 for j = 1, 2, 3, ...m do
a
heat, blood-heat injuring yin, and heat mixing commercially available devices, Healthcare Infor-
with blood. Moreover, heat pathogen invad- matics Research 23(1)(2017) 4-15.
ing lung often causes the syndrome of exuber- [3]
[4] Z. Liu, C. Yao, H. Yu, T. Wu, Deep reinforcement
ance of lung heat and the syndrome of lung- learning with its application for lung cancer detec-
heat and fu-viscera excess. The syndrome of tion in medical Internet of Things 97(2019) 1-9.
heat in chest and diaphragm can be divided in- [5] X. Liu, R. Liu, J. Ma, L. Chen, B. Qin, Privacy-
to two syndromes namely heat lying depressed preserving patient-centric clinical decision sup-
of
port system on naive bayesian classification, IEEE
in the chest and diaphragm and heat burning in
Journal of Biomedical and Health Informatics
chest and diaphragm. Moreover, the syndrome 20(2)(2016) 655-668.
of heat pathogen in intestines can be divided [6] Q. Zhang, L. T. Yang, Z. Chen, P. Li, Dependable
into two types namely heat binding in intestine
pro
deep computation model for feature learning on big
and intestinal heat and diarrhea. data in cyber-physical systems, ACM Transactions
on Cyber-Physical Systems 3 (1)(2018) 11:1-11:17.
Table 1 lists the prescription for treating [7] J. Gao, P. Li, Z. Chen, A canonical polyadic deep
each syndrome of the infectious fever. convolutional computation model for big data fea-
ture learning in Internet of Things, Future Genera-
tion Computer Systems 99(2019) 508-516.
5. Conclusion
[8] M. Z. A. Bhuiyan, J. Wu, G. Wang, Z. Chen, J.
re-
Chen, T. Wang, Quality-guaranteed event-sensitive
With the increasing development of medi- data collection and monitoring in vibration sensor
cal Internet of Things, smart Chinese medicine networks, IEEE Transactions on Industrial Infor-
has made a great progress for mining the clinic matics 13(2)(2017) 572-583.
experience of famous doctors of the tradition- [9] Q. Zhang, C. Bai, L. T. Yang, Z. Chen, P. Li, H. Yu,
al Chinese medicine. To promote the develop- A unified smart Chinese medicine framework for
lP
the main syndromes of the infectious fever by medicine with cloud computing, Concurrency and
Computation: Practice and Experience, 2019, DOI:
the syndrome differentiation of weifen, qifen,
10.1002/cpe.5252.
yingfen, and xuefen. We will validate the per- [12] M. Limper, M. D. de Kruif, A. J. Duits, D. P. M.
formance of the presented model for syndrome Brandjes, E. C. M. van Gorp, The diagnostic role of
differentiation of the infectious fever on a large Procalcitonin and other biomarkers in discriminat-
number of clinic cases in the future work. ing infectious from non-infectious fever, Journal of
Infection 60(6)(2010) 409-416.
Jo
of
Table 1: Primary prescription for each syndrome of the infectious fever.
Syndrome of infectious fever Primary prescription
pro
wind-heat invading wei yinqiao powder or sangju drink
wind-cold invading wei daqionglong decoction
exuberance of lung heat mahuang xingren gancao shigao decoc-
tion
lung-heat and fu-viscera excess xuanbai chengqi decoction
heat lying depressed in the chest and di- zhizichi decoction
aphragm
re-
heat burning in chest and diaphragm liangge powder
heat stagnation in gallbladder huangqin decoction with soybean sauce
and radix scrophulariae
heat invading lung and stomach baihu decoction
heat binding in intestine tiaoweichengqi decoction
lP
9
Journal Pre-proof
of
date on prevalence and mechanisms of resistance
to linezolid, tigecycline and daptomycin in entero-
cocci in Europe: Towards a common nomenclature,
Drug Resistance Updates 40(2018) 25-39.
pro
[16] M. G. Rasul, B. C. Majumdar, Abuse of An-
tibiotics in Aquaculture and it’s effects on human,
aquatic animal and environment, Haya: The Saudi
Journal of Life Sciences 2(2017) 81-88.
[17] C. Mulders-Manders, A. Simon, C. Bleeker-
Rovers, Fever of unknown origin, Clinical
Medicine 15(3)(2015) 280-284.
[18] B. A. Cunha, O. Lortholary, C. B. Cunha, Fever of
re-
unknown origin: a clinical approach, The American
Journal of Medicine 128(10)(2015) 1138-e1.
[19] M. Jiang, C. Liu, C. Zhang, J. Yang, Y. Tan, A.
Lu, K. Chan, Syndrome differentiation in modern
research of traditional Chinese medicine, Journal of
Ethnopharmacology 140(3)(2012) 634-642.
lP
10
Journal Pre-proof
Zhuo Liu obtained her B. M. degree from Dalian Medical University, China, in
2009. She is working towards her doctoral degree at Dalian Medical University.
Her research interest is Lung Cancer Fundamentals and Clinic.
of
Chinese Medicine, China, and a guest professor in Beijing University of Chinese
Medicine. He is one of the first famous Chinese medicine doctors in China. His
research interests include Exogenous Fever Disease, Classical Prescriptions, and
Smart Chinese Medicine.
pro
Hang Yu is is working towards the B. Sc. honours degree in Computer Science at
re-
the Department of Computer Science in St. Francis Xavier University, Canada. His
research interests include Deep Learning and Smart Medicine.
lP
Smart Medicine.
urn
Jo
of
pro
re-
a lP
urn
Jo
Journal Pre-proof
The authors declared that there is no conflict of interest.
of
pro
re-
a lP
urn
Jo
Journal Pre-proof
An adaptive deep learning for syndrome differentiation in infectious fever.
Main syndromes of infectious fever are summarized.
An adaptive dropout function is investigated to improve the effectiveness of
deep learning.
of
pro
re-
a lP
urn
Jo