SURVEY ON AUTOMATIC PRONOUNCIATION ANALYSIS

USING ARTIFICIAL INTELLIGENCE TECHNOLOGIES

Mr. Rajeshram V
Abishek R Ajay Vishwa R
Department of Computer
Department of Computer Department of Computer
Science and Engineering
Science and Engineering Science and Engineering
M.Kumarasamy College of
M.Kumarasamy College of M.Kumarasamy College of
Engineering,Thalavapalayam,
Engineering,Thalavapalayam, Engineering,Thalavapalayam
Karur, Tamilnadu, India 639113
Karur, Tamilnadu, India 639113 , Karur, Tamilnadu ,India -639113
rajeshram107@gmail.com
abishekshanthy@gmail.com ajayvishwaram111@gmail.com

Hemandh M S
Department of Computer
Science and Engineering
M. Kumarasamy College of
Engineering,Thalavapalayam
,Karur ,Tamilnadu ,India -639113
hemandhnandhini@gmail.com

ABSTRACT
The Automatic Pronunciation analysis (APA)
is an innovative language learning tool designed to
revolutionize the way individuals acquire and perfect
multicultural environments. For language learners and
their pronunciation skills. Built upon advanced speech
educators, the quest for impeccable pronunciation has long
recognition and machine learning technologies, offers a
been a fundamental challenge. Pronunciation analysis
real-time, personalized, and effective solution for
represents a groundbreaking solution to this challenge.
learners of all levels. This groundbreaking system
Language learning has evolved with advancements in
operates by capturing the user's spoken language input
technology, and stands at the forefront of this evolution.
and meticulously analysing it in comparison to the
This innovative tool harnesses the power of artificial
desired target pronunciation. Leveraging deep neural
intelligence, speech recognition, and machine learning to
networks, acoustic modelling, and phonetic analysis,
provide real-time, personalized feedback on pronunciation
then can swiftly identify and assess pronunciation
accuracy. This introduction sets the stage for a
errors, enabling users to pinpoint areas of improvement.
comprehensive exploration of the APMD, its underlying
The APA provides immediate, constructive feedback,
technologies, and its potential to transform the way we
highlighting specific mispronunciations and offering
approach language learning. By seamlessly integrating
visual representations for enhanced learning. Key
cutting-edge speech analysis techniques, offers a new
features of the APA include its adaptability to a wide
dimension in pronunciation improvement, empowering
range of languages and dialects, making it a versatile
individuals to enhance their linguistic proficiency with
tool for learners from diverse linguistic backgrounds. It
unprecedented precision and efficiency. As we delve into
can be integrated seamlessly into language learning
the intricacies of the speech processing, it becomes evident
applications, e-learning platforms, or used as a
that this tool has the potential to redefine language learning
standalone tool for self-improvement or by educators
paradigms and facilitate effective cross-cultural
and speech therapists. In this survey, explore the APA's
communication on a global scale. The pursuit of linguistic
architecture, capabilities, and its transformative
proficiency is a journey fraught with challenges, chief
potential in the realm of language learning and
among them being the acquisition and refinement of
education.
accurate pronunciation. Pronunciation, the art of
KEYWORDS: Artificial intelligence, Acoustic
articulating words and sounds correctly, is not only pivotal
modelling, Pronunciation, Speech Processing,
for clear and effective communication but also for building
Language processing
cultural empathy and understanding. Incorrect
pronunciation can lead to misunderstandings and hinder
1. INTRODUCTION
one's ability to connect with speakers of a different
In an increasingly interconnected world,
language or dialect. The traditional approach to
effective communication in a global context has
pronunciation improvement often involves human teachers
become a critical skill. Language proficiency and
and extensive practice, which, while effective, can be time-
accurate pronunciation are integral components of this
consuming and costly. Furthermore, access to experienced
skill, enabling individuals to engage with diverse
language instructors is not always readily available,
cultures, forge international relationships, and succeed
limiting the opportunity for focused, personalized learning.
in today's
This is where the APMD steps in as a transformative
solution. By harnessing the power of state-of-the-art speech
recognition technology, the APA bridges the gap between
traditional language learning and cutting-edge artificial
intelligence. It provides users with an opportunity to
receive real-time feedback on their pronunciation,
allowing them to identify and rectify mistakes as they
happen. This immediate feedback loop not only
accelerates the learning process but also boosts learners'
confidence by enabling them to track their progress in a
tangible and visible manner. The APA is versatile,
accommodating a wide array of languages and dialects,
thereby catering to the needs of learners from various
linguistic backgrounds. Additionally, its adaptability for
integration into language learning applications, e-
learning platforms, and as a stand-alone tool for self-
improvement or professional guidance has far-reaching
implications for the field of education. Educators,
speech therapists, and students alike can leverage this
tool to enhance their teaching methodologies and
language learning experiences. Beyond its practical
applications, the APA has the potential to reshape the
landscape of language research and cognitive science. It
can serve as a valuable resource for linguists studying
phonetics and pronunciation patterns, providing a
wealth of data for scientific investigation. Furthermore,
the system's data-driven approach can be employed in
automated language assessment, offering an objective
means to evaluate pronunciation skills and language
proficiency. As we embark on this journey to explore
the intricacies of the Automatic Pronunciation Detector,
we delve into the realm of transformative education,
cross-cultural understanding, and the ever-evolving
relationship between technology and language. This
exploration is a testament to the APA's promise in
enabling individuals to overcome linguistic barriers,
fostering effective communication, and ultimately
enriching lives through the power of pronunciation
perfection. Fig 1 shows the basic steps for acoustic data
handling
Figure 1: SPEECH PROCESSING STEPS
2. RELATED WORK
Cummings, Alycia, et.al,…[1] examined how
intervention dose frequency affects phonological
acquisition and generalization in preschool children
with speech sound disorders (SSD). Generalization data
for the intervention phoneme in untreated words is
reported as the average production accuracy of all post-
intervention speech probes. Recall that for a phoneme
to be considered generalized, there needed to be at least
a 10% accuracy increase from pre- to post-intervention.
Three of the four children in both dose frequency
conditions met this criterion value (Table 3). Based on
these results, both frequency groups demonstrated
generalization of the treated phoneme in untreated words.
That being said, the individual Tau-U effect size
calculations revealed that only two children (Child 3 and 4)
in the 2×/week condition demonstrated statistically
significant gains in their treated phoneme accuracy in
untreated words. Thus, the less frequent intervention
program appeared to better support the generalization of the
treated phoneme in untreated contexts than did the more
frequent intervention program.
Acquah, Emmanuel O , et.al,…[2] analysed 26
studies looking into the impact of digital games on
language learning and related outcomes from 2014 to 2018.
The majority of research was mixed methods, targeting
English language learning using computers, and was
conducted in East Asia or the Middle East. It was found
that DLGs can be used as effective L2 learning tools that
motivate players to learn and interact. DGBLL can be a fun,
engaging, and challenging way to learn, and provides
differentiation and learner autonomy. From the included
studies, 70% of the reported outcomes were entirely
positive. This is evidence of the positive outcomes of
DGBLL on primary through high school-age children.
More specifically, researchers reported outcomes from
DLGs were positive 62% of the time for language
acquisition, 81% for affective/psychological states, 88% for
contemporary competences and 62% for participatory
behaviors. While the articles did not mention outcomes
related to cultural competences or building global networks,
DLGs provide the possibility of expanding the classroom
outside of four walls by bridging schools and enabling
cross-cultural communication. In order for DLGs to be
implemented successfully, it is essential to know how
certain factors can influence the outcomes. This review
found DLGs produced positive outcomes with and without
teacher facilitation, but more insight into how teachers can
implement DGBLL is needed since none of the studies
directly analyzed implementation
Ping Li , et.al,..[3] charted an overall picture of
what DLL has evolved into, what impacts it has created,
and what future promises it may hold. We have also
attempted to provide theoretical perspectives from
psychology, education, linguistics, and neuroscience to
understand the cognitive, social, affective, and neural
dimensions of DLL. DLL has enormous potential given the
new generations of ‘digital natives’ and the interests in
digital applications and blended learning in the foreseeable
future. But significant work remains to be done to
understand the mechanisms under which DLL might
simulate language learning in its natural, authentic context
and consequently enhance its learning success. There are
also significant gaps that exist between our academic
knowledge of student learning and the industry’s
commercial product design. We need quick knowledge
transfer from academia to the industry, which is currently
hindered by many factors, including bureaucracies at
different levels, and such problems are exacerbated by the
different paces adopted by the academia versus the
industry. To mend such gaps, we need the academics to
work more closely with the industry and with policy
makers, which will facilitate and accelerate the
development of both knowledge discovery and knowledge
transfer.
Zou, Di,et.al,…[4] reviewed 21 SSCI publications
on DGVL from five perspectives: the general publication
situation, digital games for vocabulary learning, theoretical
frameworks, research issues and findings, and the
subsequent implications. It was found that DGVL has
gathered increasing attention from linguists and
educators, although the total number of studies on the
topic is small at the current stage. A large proportion of
studies have been conducted from the education
dimension, and several education theories have been
used as the theoretical foundations of the research on
DGVL. Ten different types of digital games
(simulation, tutorial, role-playing, motion-sensing, 3 D
virtual, adventure, card, board, and serious games, as
well as gamified digital books) were investigated, and
the research results generally showed positive effects of
the games in promoting short-term and long-term
vocabulary learning. In addition to facilitating
vocabulary learning, digital games were found to be
conducive to reading and listening comprehension, as
well as pronunciation improvement. Game-players also
were viewed as having higher motivation, better
engagement and more interactions than students who
learned through other approaches, in addition to being
less stressed. Moreover, despite the limited number of
studies on DGVL, insightful findings and meaningful
implications were reported.
BALLARD,et.al,…[5] presented Apraxia
World, a speech therapy game designed to give children
more independence and make therapy practice more
enjoyable. Apraxia World is unique from other speech
therapy games in that players control the game using
traditional joystick and button inputs, while speech
input is used to collect in-game assets necessary to
complete the level. The game also supports
pronunciation feedback provided by caregivers or an
automatic evaluation framework. To validate our game
design and speech therapy delivery approach, we
evaluated the long-term home use and clinical benefit of
Apraxia World over a multi-month period. Children
reported enjoying the game, even over the long play
period. Game personalization through in-game
purchases of costumes, weapons, and avatars proved to
be a widely popular aspect of the game.
Tejedor-Garcia, et.al,…[6] described and
analysed a novel learning game for pronunciation
training in which players can challenge each other. The
mobile game application turned out to be a useful
resource for English pronunciation training. It relied on
speech technologies (ASR and TTS) which have proved
to be particularly useful for increasing the amount of
game intensity, immediate feedback, and model
pronunciations available to the students. It was also
based on a specific cycle of pronunciation activities
following the minimal pairs paradigm. Native Spanish
speakers played the game in a competition for English
as foreign language pronunciation training, where a
performance and motivation analysis was done to
examine the effects of challenging. We have studied an
important issue, with the current drive by educators to
discover new ways to motivate students to encourage
effective uptake. Despite the fact that collaborative and
competitive strategies in second language learning
continue to invite discussion and disagreement on
which one should be included as an effective element of
motivation and performance for students, we have
observed that the explicitly competitive structure of the
game resulted in more positive effects on student
performance and motivation than a previous version of
the game, in terms of a higher number of activities
(game intensity) and greater playing regularity.
Bashori, Muzakki, et.al,…[7] presented study are
to get more insight into the kind of linguistic gain the
students made. English was the target language in this
study. Our vocabulary test consisted of three different parts
and these parts may provide relevant information on the
receptive and productive aspects of learning vocabulary. In
addition, we asked a subset of the students to pronounce
target words, as pronunciation might be an aspect that is
affected directly through ASR systems. We also employed
an open-source software package, the Automated Phonetic
Transcription Comparison Tool (APTct), to help analyze
learners’ speech. Two preliminary studies evaluated these
ASR-based websites and investigated to what extent they
affect learners’ cognitive and affective domains. The results
revealed that these websites were evaluated positively and
helped learners improve their vocabulary knowledge,
reduce their speaking anxiety, and enhance their language
enjoyment.
Shi, Jiatong ,et.al,…[8] proposed the context-
aware GOP (CaGOP) scoring model in this work, which
injects two context related factors into the model, the
transition factor and duration factor. The transition factor is
represented using the frame-wise posterior-probability
entropy. The duration factor is represented based on the
duration mismatch, which is computed using a duration
model with selfattention network. However, the above
GOP-like methods do not fully consider the context
information within and between the phonetic segments.
Within the segments, the scoring strategies depend on the
forced-alignments. The forced-alignments split the entire
speech sequence into phonetic segments corresponding to
reference phonemes. Based on the facts of speech
production, the vocal tract is gradually changing in the
production of different phonemes. Therefore, a hard
assignment of phonemes in time domain would include the
transition between phonemes within the force-aligned
segments. As the GOP based model does not consider the
context information between phonetic segments, it does not
consider the pronunciation phenomena from contextual
phonemes. To tackle this issue, we introduce duration
factor as the prosody context to the pronunciation scoring.
The computation of the duration factor includes two steps.
First, we use a context-dependent duration model to predict
the duration for the given phoneme sequences. Then, we
refer the duration factor as the phonetic duration mismatch
between the reference and the test utterances
Baevski, Alexei, et.al,…[9] presented wav2vec
2.0, a framework for self-supervised learning of speech
representations which masks latent representations of the
raw waveform and solves a contrastive task over quantized
speech representations. Our experiments show the large
potential of pre-training on unlabeled data for speech
processing: when using only 10 minutes of labeled training
data, or 48 recordings of 12.5 seconds on average, we
achieve a WER of 4.8/8.2 on test-clean/other of
Librispeech. Neural networks benefit from large quantities
of labeled training data. However, in many settings labeled
data is much harder to come by than unlabeled data: current
speech recognition systems require thousands of hours of
transcribed speech to reach acceptable performance which
is not available for the vast majority of the nearly 7,000
languages spoken worldwide. Learning purely from labeled
examples does not resemble language acquisition in
humans: infants learn language by listening to adults
around them - a process that requires learning good
representations of speech.
 Li-Wei Chen, et.al,…[10] described different 3. EXISTING METHODOLOGIES
fine-tuning strategies for wav2vec 2.0 on SER. These Automatic pronunciation in the context of TTS
strategies produce SOTA performance on IEMOCAP, a involves converting written text into spoken language with
well-studied corpus. We verify the presence of domain correct pronunciation, intonation, and natural-sounding
shift in SER and demonstrate that addressing it speech.
improves performance. We describe an algorithm for
learning contextualized emotion representation and RULE BASED ALGORITHM
show its advantage in fine-tuning a wav2vec 2.0 model A rule-based system for pronunciation mistake
for SER. We believe that these techniques can be detection is designed to identify and correct
generalized to other tasks and can provide a basis for mispronunciations in speech or text-to-speech (TTS)
research on the utility of contextualized emotion applications by applying predefined linguistic rules. These
representation. We intend to continue exploring the rules encompass various aspects of phonology and
usefulness of this approach, in a multi-modal setting phonetics, including phoneme pronunciation, stress
Table 1 provides the overall details about literature patterns, syllable divisions, and contextual variations. The
survey papers. system maintains comprehensive dictionaries mapping
NO TECHNIQ MERITS DEMERITS words to their correct pronunciation and employs phonetic
UES transcription, such as the International Phonetic Alphabet
1 Percent Provide the Manual (IPA), to represent words accurately. When a user input or
consonants score based on intervention TTS output deviates from these rules, the system flags it as
correct consonants can be need a pronunciation mistake and offers feedback or correction
(PCC) sound suggestions based on the established rules. It's a valuable
2 Digital Analyze the Expert tool for improving the correctness and naturalness of
learning behaviors of knowledge speech synthesis, but may have limitations when dealing
games students needed with complex or rare pronunciation variations. Combining
(DLGs) rule-based systems with data-driven techniques can
framework enhance overall performance.
3 Digital Provide a Theoretical Machine learning methods
language theoretical and practical Machine learning can be defined as artificial
learning synthesis and problems can intelligence algorithms that can infer and predict from data
(DLL) analytical occur to mimic the way humans learn. There are various machine
framework learning algorithms that are capable of solving
4 Short-term Several Large number classification, regression and clustering tasks. In our work,
and long- education of analyses are popular methods suitable for classification problem are
term theories have required emphasized which are support vector machine (SVM), k-
vocabulary been used Nearest neigbour (k-NN), decision tree (DT) and naïve
learning Bayes
5 Template Increase There is no SVM is a supervised learning approach. Kernel
matching practice automatic functions can also be used depending on the type of data
(TM) frequency evaluation during the operation of the algorithm. In this way, both
framework linear and nonlinear classification operations can be
6 Scoring Novel learning Computational performed. It is aimed to separate all data with a
system game for complexity is hyperplane. However, if the data cannot be fully separated,
pronunciation high they cannot be classified with a single plane. Therefore,
training different kernel functions are used. A margin is determined
7 Novo Targeted Statistical around the hyperplane. Whether this margin is large or
Learning vocabulary based analysis small directly affects the classification performance.
(NOVO) and Margin can be controlled with the “C” hyperparameter. The
system pronunciation larger the C, the narrower the margin. Also, if the model is
skills overfit, C needs to be reduced. In this work linear kernel
8 Context- Improvement Time and 0.02 used as C parameter.
aware for phonetic complexity k-NN is basically based on the determination of
Goodness of duration can be high the class of the data whose class is unknown, according to
Pronunciatio prediction the nearest “k” neighbor from the data in the training set.
n (CaGOP) As a result of performing a distance measurement between
scoring the test data and the training data, the nearest “k” nearest
model neighbors are determined. Then, the class value of the
tested data is determined according to these labels.
9 wav2vec Masks latent Less number
Basic purpose of decision trees is to divide the
construction representation of labeled
data set into smaller subgroups that are more visually
s of the raw datasets are
understandable within the framework of certain rules
waveform used
(decision rules). Since the output of the algorithm is a
10 Task Learning Only classify
flowchart that looks like a tree visually, it is called a
adaptive contextualized the tone of
decision tree. There are 4 basic structures on a decision
pretraining emotion speech
tree: root node, nodes, branches and leaves (terminal node).
(TAPT) representation
The root node is where classification process starts from
TABLE 1: SURVEY PAPERS FOR STUDENT
this point. If the observations are in a homogeneous
SKILLS ANALYSIS
structure, they will naturally be in the same class and the
classification process will end without branching the formats, such as WAV files, and segmenting it
root node. In heterogeneous observations, the root node into words or phrases.
divides into two or more branches according to the best  Feature Extraction: Extract acoustic features from
quality that divides the observations into classes and the audio data. Common features include Mel-
creates new nodes. The last non-branching node of the frequency cepstral coefficients (MFCCs), pitch,
tree is the terminal node and represents the classes to and energy.
which the observations are assigned.  Labeling and Ground Truth: Label the audio data
Naïve Bayes classification is based on Bayes with correct and incorrect pronunciation labels,
theorem. It is used to estimate the probability that a using the phonetic transcriptions and provided
particular set of features belongs to a particular class. It reference data.
aims to select the decision with the highest probability  CNN Architecture: Design a CNN architecture for
using probability calculations. Each attribute is pronunciation assessment. Consider using 1D
considered independent from other attributes in the CNNs, as they are well-suited for sequential audio
class. different class based on various attributes. Naïve data.
Bayes classifiers are extremely fast compared to more  Configure the network to have convolutional
complex methods. layers for feature extraction, followed by fully
connected layers for classification.
4. PROPOSED METHODOLOGIES  Training the Model: Train the CNN using the
The proposed system aims to address the labelled dataset. The model learns to distinguish
importance of precise pronunciation in effective between correct and incorrect pronunciations
communication, language learning, and text-to-speech based on the extracted acoustic features. Fine-tune
applications. This system is built on the foundation of hyperparameters and model architecture as
Convolutional Neural Networks (CNNs) and comprises needed.
several key components. Initially, it involves the
collection and preprocessing of a diverse dataset of
spoken language, containing both correctly pronounced
words and phrases, accompanied by their corresponding
phonetic transcriptions. This data is then meticulously
preprocessed, which includes converting audio into a
standardized format, segmenting it into individual
words or phrases, and extracting pertinent acoustic
features like Mel-frequency cepstral coefficients
(MFCCs), pitch, and energy. The dataset is further
enriched through labeling, with audio data being
annotated as having either correct or incorrect
pronunciation, using the provided phonetic
transcriptions as a reference for correctness. To
facilitate model development and assessment, the
dataset is divided into training, validation, and test
subsets. The heart of the system lies in the design of a
CNN architecture optimized for pronunciation
assessment. This CNN model is trained using the
labeled dataset, teaching it to distinguish between
correct and incorrect pronunciations based on the
acoustic features. The system also incorporates a
feedback mechanism, offering users insights into
detected pronunciation mistakes, such as highlighting Fig 2 shows the proposed work for spoken
mispronounced words or providing suggestions for language detection
correct pronunciation. Furthermore, a user-friendly 5. EXPERIMENTAL RESULTS
interface enables real-time pronunciation checking, Performance metrics are essential for assessing the
allowing users to input spoken language or text and effectiveness of a system or model. In the context of an
receive immediate feedback on their pronunciation automatic pronunciation checker system using
quality. The system is engineered to be versatile, Convolutional Neural Networks (CNNs), the following
supporting multiple languages and dialects and performance metrics can be considered:
constantly improving its capabilities by incorporating
user feedback and undergoing periodic model
retraining. Ultimately, this proposed system represents a Accuracy: Accuracy measures the proportion of
comprehensive solution for enhancing pronunciation correctly classified pronunciations (both correct and
accuracy and promoting effective language learning and incorrect). It's a fundamental metric for evaluating the
communication. overall performance of the system.
Fig 2 shows the proposed architecture and the
proposed work is described as follows:
 Data Collection and Preprocessing: Gather a
dataset of spoken language with corresponding
phonetic transcriptions, which serve as the
reference for correct pronunciation. Preprocess
the audio data by converting it to suitable

ACCURACY (%)
80
70
60
50
40
30
20
10
0 [10]Chen, Li-Wei, and Alexander Rudnicky. "Exploring
SVM KNN NAIVES CNN
BAYES
Fig 3: Performance chart
From the above graph, proposed algorithm provides the
improved accuracy rate than the existing machine
learning algorithms
6. CONCLUSION
In survey, the proposed "Automatic
Pronunciation Checker with Convolutional Neural
Networks" system holds significant promise in
addressing the critical need for accurate pronunciation
in language learning, communication, and text-to-
speech applications. Leveraging the power of
Convolutional Neural Networks (CNNs), this system
offers a comprehensive solution for assessing and
improving pronunciation quality. By meticulously
collecting and preprocessing diverse spoken language
data, including phonetic transcriptions, the system lays
a robust foundation for pronunciation assessment. Its
CNN architecture is tailored to effectively differentiate
between correct and incorrect pronunciations based on
extracted acoustic features, such as MFCCs, pitch, and
energy. Moreover, the incorporation of a feedback
mechanism and a user-friendly interface ensures real-
time pronunciation checking, providing users with
valuable insights and corrective guidance.
REFERENCES
[1] Cummings, Alycia, Kristen Giesbrecht, and Janet
Hallgrimson. "Intervention dose frequency:
Phonological generalization is similar regardless of
schedule." Child Language Teaching and Therapy 37.1
(2021): 99-115.
[2] Acquah, Emmanuel O., and Heidi T. Katz. "Digital
game-based L2 learning outcomes for primary through
high-school students: A systematic literature
review." Computers & Education 143 (2020): 103667.
[3] Li, Ping, and Yu-Ju Lan. "Digital language learning
(DLL): Insights from behavior, cognition, and the
brain." Bilingualism: Language and Cognition 25.3
(2022): 361-378.
[4] Zou, Di, Yan Huang, and Haoran Xie. "Digital
game-based vocabulary learning: where are we and
where are we going?" Computer Assisted Language
Learning 34.5-6 (2021): 751-777.
[5] BALLARD, KIRRIE J., CONSTANTINA
MARKOULLI, and PENELOPE MONROE. "A
Longitudinal Evaluation of Tablet-Based Child Speech
Therapy with Apraxia World." (2021).
[6] Tejedor-Garcia, Cristian, et al. "Using challenges to
enhance a learning game for pronunciation training of
English as a second language." IEEE Access 8 (2020):
74250-74266.
[7] Bashori, Muzakki, et al. "‘Look, I can speak correctly’:
learning vocabulary and pronunciation through websites
equipped with automatic speech recognition
technology." Computer Assisted Language
Learning (2022): 1-29.
[8] Shi, Jiatong, Nan Huo, and Qin Jin. "Context-aware
goodness of pronunciation for computer-assisted
pronunciation training." arXiv preprint
arXiv:2008.08647 (2020).
[9] Baevski, Alexei, et al. "wav2vec 2.0: A framework for
self-supervised learning of speech
representations." Advances in neural information
processing systems 33 (2020): 12449-12460.
Wav2vec 2.0 Fine Tuning for Improved Speech Emotion
Recognition." ICASSP 2023-2023 IEEE International
Conference on Acoustics, Speech and Signal Processing
(ICASSP). IEEE, 2023.
[11] Almelhes, Sultan A. "A Review of Artificial
Intelligence Adoption in Second-Language
Learning." Theory and Practice in Language Studies 13.5
(2023): 1259-1269.
[12] Ngo, Thuy Thi-Nhu, Howard Hao-Jan Chen, and Kyle
Kuo-Wei Lai. "The effectiveness of automatic speech
recognition in ESL/EFL pronunciation: A meta-
analysis." ReCALL (2023): 1-18.
[13] Zakiyyah, Fina, Arso Setyaji, and Sukma Nur Ardini.
"The analysis of pronunciation application based on the
concept of Artificial Intelligence." UNCLLE
(Undergraduate Conference on Language, Literature, and
Culture). Vol. 2. No. 01. 2022.
[14] Nugraha, Sandy Vitra, Lalu Ari Irawan, and Tina Orel
Frank. "Segmental Aspects of Pronunciation Errors
Produced by ELE Students in Classroom Settings." Journal
of Language and Literature Studies 2.2 (2022): 88-98.
[15] Yuzawa, Nobuo. "An Analysis of Two English
Textbooks for Elementary School in Japan: Focusing on
Teaching Pronunciation." Journal of the Faculty of
International Studies, Utsunomiya University 53 (2022):
103-116.
[16] Peura, Liisa, Maarit Mutta, and Marjut Johansson.
"Playing with Pronunciation: A study on robot-assisted
French pronunciation in a learning game." Nordic Journal
of Digital Literacy 2 (2023): 100-115.
[17] Al-Jarf, Reima. "Proper noun pronunciation
inaccuracies in English by Educated Arabic
speakers." British Journal of Applied Linguistics
(BJAL) 4.1 (2022): 14-21.
[18] Adam, Nuflihin Surya, Agus Hidayat, and Muhammad
Ridho Kholid. "An Analysis of Pronunciation in Word
Stress Towards Students of Sixth Semester of English
Education at UIN Raden Intan Lampung." Journal of
Linguistics and Social Sciences 1.2 (2023): 59-65.
[19] Maiza, Masfa. "An analysis of students’ pronunciation
errors." JOEEL: Journal of English Education and
Literature 1.1 (2020): 18-23.
[20] Rafael, Agnes Maria Diana. "An analysis on
pronunciation errors made by first semester students of
English department STKIP CBN." Loquen: English
Studies Journal 12.1 (2019): 1-10.
[21] Ngo, Thuy Thi-Nhu, Howard Hao-Jan Chen, and
Kyle Kuo-Wei Lai. "The effectiveness of automatic
speech recognition in ESL/EFL pronunciation: A meta-
analysis." ReCALL (2023): 1-18.
[22] Astina, Nurhamdah. "The analysis of teaching
English pronunciation at young learners." Inspiring:
English Education Journal 3.1 (2020): 1-16.
[23] Kibria, Shafkat, et al. "Acoustic analysis of the
speakers’ variability for regional accent-affected
pronunciation in Bangladeshi bangla: a study on Sylheti
accent." IEEE Access 8 (2020): 35200-35221.
[24] Ambalegin, Ambalegin. "Phonological Analysis of
English Vowel Pronunciation." KnE Social
Sciences (2021): 28-45.
[25] Cengiz, Behice Ceyda. "Computer-Assisted
Pronunciation Teaching: An Analysis of Empirical
Research." Participatory Educational Research 10.3
(2023): 72-88.
[26] Du, Minghao, et al. "An Automatic Depression
Recognition Method from Spontaneous Pronunciation
Using Machine Learning." Proceedings of the 2022 9th
International Conference on Biomedical and
Bioinformatics Engineering. 2022.
[27] Han, Xue, and Trip Huwan. "The modular design
of an english pronunciation level evaluation system
based on machine learning." Security and
Communication Networks 2022 (2022).
[28] Du, Minghao, et al. "An Automatic Depression
Recognition Method from Spontaneous Pronunciation
Using Machine Learning." Proceedings of the 2022 9th
International Conference on Biomedical and
Bioinformatics Engineering. 2022.
[29] Han, Xue, and Trip Huwan. "The modular design
of an english pronunciation level evaluation system
based on machine learning." Security and
Communication Networks 2022 (2022).
[30] Rukwong, Niyada, and Sunee Pongpinigpinyo.
"An Acoustic Feature-Based Deep Learning Model for
Automatic Thai Vowel Pronunciation
Recognition." Applied Sciences 12.13 (2022): 6595.
[31] Gong, Yuan, et al. "Transformer-based multi-
aspect multi-granularity non-native English speaker
pronunciation assessment." ICASSP 2022-2022 IEEE
International Conference on Acoustics, Speech and
Signal Processing (ICASSP). IEEE, 2022.
[32] Kim, Eesung, et al. "Automatic pronunciation
assessment using self-supervised speech representation
learning." arXiv preprint arXiv:2204.03863 (2022).
[33] Kim, Eesung, et al. "Automatic pronunciation
assessment using self-supervised speech representation
learning." arXiv preprint arXiv:2204.03863 (2022).
[33] Xu, Yushu. "English speech recognition and
evaluation of pronunciation quality using deep
learning." Mobile Information Systems 2022 (2022): 1-
12.
[34] Tang, Hui. "An automatic correction system of
singing intonation based on deep
learning." International Journal of Information and
Communication Technology 22.4 (2023): 422-437.
[35] Cámara-Arenas, Enrique, et al. "Automatic
pronunciation assessment vs. automatic speech
recognition: A study of conflicting conditions for L2-
English." (2023).
[36] Bi, Yanjing, et al. "A RTL Implementation of
Heterogeneous Machine Learning Network for French
Computer Assisted Pronunciation Training." Applied
Sciences 13.10 (2023): 5835.
[37] Zhao, Xiaoda, and Xiaoyan Jin. "Standardized
evaluation method of pronunciation teaching based on deep
learning." Security and Communication Networks 2022
(2022).
[38] Alashban, Adal A., and Yousef A. Alotaibi. "A Deep
Learning Approach for Identifying and Discriminating
Spoken Arabic Among Other Languages." IEEE Access 11
(2023): 11613-11628.
[39] Korzekwa, Daniel, et al. "Computer-assisted
pronunciation training—Speech synthesis is almost all you
need." Speech Communication 142 (2022): 22-33.
[40] Wang, Xiaoman, and Lu Yuan. "Machine-learning
based automatic assessment of communication in
interpreting." Frontiers in Communication 8 (2023):
1047753.
[41] Lu, Yijia, et al. "Decoding lip language using
triboelectric sensors with deep learning." Nature
communications 13.1 (2022): 1401.
[42] Harere, Ahmad Al, and Khloud Al Jallad.
"Mispronunciation Detection of Basic Quranic
Recitation Rules using Deep Learning." arXiv preprint
arXiv:2305.06429 (2023).
[43] Wei, Xing, et al. "Automatic Speech Recognition
and Pronunciation Error Detection of Dutch Non-
native Speech: cumulating speech resources in a
pluricentric language." Speech Communication 144
(2022): 1-9.
[44] Wu, Yanping, et al. "Implementation of a System
for Assessing the Quality of Spoken English
Pronunciation Based on Cognitive Heuristic
Computing." Computational Intelligence and
Neuroscience 2022 (2022).
[45] Wu, Yanping, et al. "Implementation of a System
for Assessing the Quality of Spoken English
Pronunciation Based on Cognitive Heuristic
Computing." Computational Intelligence and
Neuroscience 2022 (2022).
[46] Çalik, Şükrü Selim, Ayhan Küçükmanisa, and
Zeynep Hilal Kilimci. "Deep Learning-Based
Pronunciation Detection of Arabic Phonemes." 2022
International Conference on INnovations in Intelligent
SysTems and Applications (INISTA). IEEE, 2022.
[47] Mathad, Vikram C., et al. "Consonant-vowel
transition models based on deep learning for objective
evaluation of articulation." IEEE/ACM Transactions
on Audio, Speech, and Language Processing 31
(2022): 86-95.
[48] Sheoran, Kavita, et al. "Pronunciation Scoring
With Goodness of Pronunciation and Dynamic Time
Warping." IEEE Access 11 (2023): 15485-15495.
[49] Malakar, Mousumi, Ravindra B. Keskar, and Ajit
Zadgaonkar. "A hierarchical automatic phoneme
recognition model for Hindi‐Devanagari consonants
using machine learning technique." Expert
Systems (2023): e13288.
[50] Liu, Nian. "Automatic English Pronunciation
Evaluation Algorithm Based on Sequence Matching
and Feature Fusion." Mathematical Problems in
Engineering 2022 (2022).