BATCH – A06

CHAPTER – III
SYSTEM ANALYSIS

3.1 OVERVIEW

In this System Analysis, the existing system utilizes innovative methods for handwritten math expression
recognition. It employs structural analysis, efficient symbol recognition, and decoding algorithms. However, it
has limitations, including layout challenges and symbol recognition accuracy. The proposed Handwritten Math
Expression Recognition & Calculation Web App is a groundbreaking solution. It combines deep learning,
component relationships, and cloud-based techniques, predicting LaTeX markup while generating detailed
outputs. It offers end-to-end mobile recognition, personalization, context-aware features, and multi-modal
input, addressing the existing system's shortcomings effectively.

3.2 EXISTING SYSTEM

The existing system encompasses various methodologies for enhancing the recognition of online
handwritten mathematical expressions, addressing a multitude of challenges commonly encountered in this
domain. One of the prominent methods introduced involves a structural analysis approach, employing
minimum spanning tree construction and symbol dominance. This method adeptly handles layout
irregularities frequently present in handwritten formula recognition systems, such as symbol overlapping and
the alignment of arguments within sum-like operators. It further extends its capabilities to accommodate
non-standard operator layouts and complex tabular arrangements like matrices. Another noteworthy aspect
of the existing system is its efficient on-line recognition system for symbols within handwritten
mathematical expressions. This system operates by constructing a network of symbol hypotheses and
subsequently classifying the elements within this network. The final classification is determined by
calculating the most probable path through the network, incorporating stroke group probabilities and
leveraging the outcomes of the symbol recognizer, grounded in hidden Markov models. Additionally, the
existing system presents a novel algorithm that orchestrates symbol decoding and graph generation for
online handwritten mathematical expression recognition. Notably, the symbol sequence aligned with the
optimal path within the graph exhibits substantially heightened symbol recognition accuracy, especially
following rescoring with trigram models. Consequently, the overall performance of mathematical formula
recognition experiences a significant enhancement, further contributing to the system's prowess in
deciphering complex handwritten mathematical expressions.
3.2.1 DRAWBACKS OF EXISTING SYSTEM

 Layout Complexity: Existing systems often struggle with layout irregularities in handwritten
mathematical expressions, such as symbol overlapping and non-standard operator arrangements, limiting
their ability to accurately interpret complex structures.
 Limited Symbol Recognition Accuracy: Despite employing symbol hypotheses networks and
classification techniques, the existing system faces challenges in achieving consistently high symbol
recognition accuracy, particularly in scenarios involving intricate expressions.
 Dependency on Stroke Grouping: Dependency on stroke grouping as a part of symbol identification
can introduce inaccuracies and uncertainties, impacting the overall recognition performance, especially
when dealing with poorly separated strokes.
 Graph Complexity: While the generation of symbol graphs is an advancement, the complexity of these
graphs may sometimes lead to increased computational overhead and complexity in the post-processing
stage.
 Scalability to Mathematical Notation Variability: Existing systems may struggle to scale effectively
across a wide range of mathematical notations and domains, limiting their adaptability to different styles
and conventions of handwritten expressions.
 Challenges in Complex Tabular Arrangements: Despite efforts to handle tabular arrangements like
matrices, existing systems may encounter difficulties in accurately parsing and recognizing complex
tabular structures within handwritten expressions.
 Sensitivity to Noise and Variability: Handwritten expressions inherently exhibit variability and noise,
and existing systems may lack robustness when faced with diverse handwriting styles, ink variations,
and other sources of noise.
 Limited Post-Processing Flexibility: The approach of generating symbol graphs, while innovative, may
restrict the ability to apply diverse post-processing techniques effectively, potentially impacting the
refinement of recognition results.
 Performance Bottlenecks: Some existing systems may experience performance bottlenecks, especially
when dealing with large and complex mathematical expressions, leading to slower processing times and
reduced user experience.
 Dependency on Training Data: The accuracy of existing systems heavily relies on the availability and
diversity of training data, which may lead to challenges in accurately recognizing symbols that were
not well-represented in the training set.

3.3 MATH SCRIBBLE

 The Handwritten Mathematical Expression Recognition & Calculation Web App introduces a
myriad of innovative advantages that redefine the landscape of mathematical expression recognition. By
amalgamating cutting-edge deep learning techniques with pioneering methodologies from preceding studies,
this project creates a distinctive niche for itself. It transcends the conventional realm of handwritten digit
recognition by seamlessly incorporating advanced prediction capabilities and component relationship
analysis. Notably, it goes beyond predicting LaTeX markup outcomes; it generates intricate tree-structured
outputs, meticulously depicting the intricate interactions within mathematical expressions. Rigorous
experiments conducted on benchmark datasets and the exclusive HME100K dataset underscore the
exceptional efficacy and efficiency of this approach, showcasing its potential across varied handwriting
styles and expressions.

Furthermore, the project's purview extends to addressing key challenges in mathematical expression
recognition. It delves into end-to-end recognition for mobile platforms, acknowledging the increasing
demand for holistic solutions in this domain. Cloud solutions and federated learning strategies synergize to
enhance recognition accuracy while adapting to iterative inputs. Personalization-oriented approaches
enhance the system's adaptability, allowing it to cater to individual handwriting patterns, thereby reducing
ambiguity and elevating recognition precision. Context-aware methodologies, often overlooked in HME
recognition, find prominence here, transitioning from isolated recognition to accommodating multi-
dimensional expressions within broader document contexts. The project's prowess in recognizing complex
structural objects demonstrates its adaptability and foresight.

A standout advantage lies in its potential for enriching sketch-based applications. It pioneers multi-
modality, offering seamless transitions between keyboard, mouse, handwriting, and voice control inputs,
ensuring a user-centric experience. Augmented and mixed reality integration opens avenues for enhanced
interaction with mathematical expressions in fields such as education and productivity applications. This
project significantly advances the syntax-aware network, merging grammar rules with deep feature learning
to predict LaTeX markup outcomes and generate detailed tree-structured outputs. The project's commitment
to innovation, adaptability, and future expansion reinforces its role as a transformative force in the domain of
mathematical expression recognition.
3.3.1 ADVANTAGES OF PROPOSED SYSTEM

 Advanced Prediction and Component Relationship: A standout feature of the proposed system is its
ability to predict LaTeX markup outcomes while simultaneously generating precise tree-structured
outputs that intricately describe the relationships between different components within mathematical
expressions.
 End-to-End Recognition for Mobile Platforms: In response to the burgeoning demand for seamless
end-to-end recognition on mobile platforms, the proposed system not only addresses the intricacies of
such solutions but also caters to iterative input requirements.
 Cloud Solutions and Federated Learning: The integration of online and offline HME recognition
methods, supported by competition results, underscores the project's commitment to accuracy
enhancement.
 Personalization and Flexibility: By focusing on personalization-oriented approaches, such as
reinforcement learning and few-shot learning, the system adapts to individual users' handwriting
patterns.
 Context-Aware Approaches: The proposed system ventures into uncharted territory by exploring
context-aware methods for HME recognition. This shift towards recognizing multiple HME inputs
within the context of a document minimizes ambiguities arising from complex mathematical characters
and structures.
 HME Complexity and Domain Adaptation: The project's recognition capabilities extend beyond the
limitations of commercial systems, addressing the diverse mathematical symbols employed across
various scientific and engineering domains. This expansion ensures accuracy and relevance in a variety
of contexts.
 Seamless HME Detection: By prioritizing seamless HME detection, the system enables smooth
recognition of different document elements during handwritten input. This mirrors the natural "pen and
paper" interaction, enhancing user experience and practicality.
 Enriching Sketch-Based Applications: The project's integration of HME recognition with sketch-based
applications enhances interactive visualizations based on mathematical concepts. This integration
transcends industries, opening avenues in fields like chemistry and finance.
 Multi-Modality and Mixed Reality: The system's support for multiple input modes, including keyboard,
mouse, handwriting, and voice control, ensures user flexibility. Moreover, its embrace of mixed and
augmented reality promises enhanced interaction with mathematical expressions, particularly in
educational and productivity contexts.
3.4 SUMMARY
In the domain of online handwritten mathematical expression recognition, the existing system employs
structural analysis and symbol recognition techniques, yet faces challenges in layout complexities and
symbol accuracy. The proposed Handwritten Mathematical Expression Recognition & Calculation Web App
redefines this landscape. It combines deep learning, component relationship analysis, and context-aware
methodologies to predict LaTeX markup while generating precise tree-structured outputs. This system
thrives on mobile platforms, integrates cloud solutions, and personalizes recognition for individual users. It
addresses complexities across scientific domains and enriches sketch-based applications, promising multi-
modality input and augmented reality interactions. The proposed system is a transformative force, offering
advanced prediction, adaptability, and user-centric features for diverse applications, setting new standards in
mathematical expression recognition.