Unit 1

Introduction
NLP
NLP is a branch of data science that consists of systematic processes for analyzing, understanding,
and deriving information from the text data in a smart and efficient manner.

Natural Language Processing can be stated in layman terms as the automatic processing of the
natural human language by a machine. It is a specialized branch of Artificial Intelligence that
primarily focuses on interpretation as well as human-generated.
Processing
There are seven processing levels: phonology, morphology, lexicon, syntactic, semantic,
speech, and pragmatic.
Phonology identifies and interprets the sounds that makeup words when the machine has to
understand the spoken language.
Morphology is concerned with the composition and nature of words, morphology, dividing
them into morphology (meaning smaller units that constitute the words ending root radical,
affix, topic, and theme vowel). Simultaneously, the syntactic process analyzes the formation of
sentences and the specification of the structures allowed in the language.
The lexicon analyzes the input of character lines (like the program’s source code). It produces a
sequence of lexical symbols (lexical tokens). It captures the meaning of words.
The semantic analysis concerns the meaning of the phrase. Extracts the meaning of the
syntactic structure. And the speech verifies the overall meaning of the text.
Finally, the pragmatic approach interprets the concepts extracted from the text, checks whether
the meaning of the semantic analysis is correct, and defines meanings that are not clear.
Stages/Levels
Advantages of NLP
● Users can ask questions about any subject and get a direct response within seconds.
● NLP system provides answers to the questions in natural language
● NLP system offers exact answers to the questions, no unnecessary or unwanted information
● The accuracy of the answers increases with the amount of relevant information provided in the question.
● NLP process helps computers communicate with humans in their language and scales other language-
related tasks
● Allows you to perform more language-based data compares to a human being without fatigue and in an
unbiased and consistent way.
● Structuring a highly unstructured data source

Disadvantages of NLP
● Complex Query Language- the system may not be able to provide the correct answer it the question that is
poorly worded or ambiguous.
● The system is built for a single and specific task only; it is unable to adapt to new domains and problems
because of limited functions.
● NLP system doesn’t have a user interface which lacks features that allow users to further interact with the
system
Applications of NLP
Applications of NLP
There are the following applications of NLP -

1. Question Answering

Question Answering focuses on building systems that automatically answer the questions asked by humans in a natural language.
2. Spam Detection

Spam detection is used to detect unwanted e-mails getting to a user's inbox.

3. Sentiment Analysis

Sentiment Analysis is also known as opinion mining. It is used on the web to analyse the attitude, behaviour, and
emotional state of the sender. This application is implemented through a combination of NLP (Natural Language
Processing) and statistics by assigning the values to the text (positive, negative, or natural), identify the mood of the
context (happy, sad, angry, etc.)
4. Machine Translation

Machine translation is used to translate text or speech from one natural language to another natural language.

Example: Google Translator

5. Spelling correction

Microsoft Corporation provides word processor software like MS-word, PowerPoint for the spelling correction.
6. Speech Recognition

Speech recognition is used for converting spoken words into text. It is used in applications, such as mobile,
home automation, video recovery, dictating to Microsoft Word, voice biometrics, voice user interface, and so
on.

7. Chatbot

Implementing the Chatbot is one of the important applications of NLP. It is used by many companies to
provide the customer's chat services.
8. Information extraction

Information extraction is one of the most important applications of NLP. It is used for extracting structured
information from unstructured or semi-structured machine-readable documents.

9. Natural Language Understanding (NLU)

It converts a large set of text into more formal representations such as first-order logic structures that are
easier for the computer programs to manipulate notations of the natural language processing.