This document discusses the topics of natural language processing including data processing, text normalization, sentence segmentation, word segmentation, removing stop words and special characters, text lemmatization and stemming, and converting text to a common case. These techniques are covered in Unit 6 of an artificial intelligence class.
This document discusses the topics of natural language processing including data processing, text normalization, sentence segmentation, word segmentation, removing stop words and special characters, text lemmatization and stemming, and converting text to a common case. These techniques are covered in Unit 6 of an artificial intelligence class.
This document discusses the topics of natural language processing including data processing, text normalization, sentence segmentation, word segmentation, removing stop words and special characters, text lemmatization and stemming, and converting text to a common case. These techniques are covered in Unit 6 of an artificial intelligence class.
TOPICS 1. DATA PROCESSING 2. TEXT NORMALIZATION a. SENTENCE SEGMENTATION b. WORD SEGMENTATION c. REMOVING STOP WORDS, SPECIAL CHARACTERS AND NUMBERS d. TEXT LEMMATIZATION AND STEMMING e. CONVERTING TEXT TO A COMMON CASE