Download as pptx, pdf, or txt
Download as pptx, pdf, or txt
You are on page 1of 16

By Dr.

Karuna
Sample data set for Text Mining
Process
Table 1: A Sample Tweets Extracted from Twitter account for Sony Brand
@Geeta Sony Xperia is BEAUTIFUL 5-inch  Full HD display ;)
@Naveen Sony mobile Sleek, strong, waterproof design
@Santhosh Sony Xperia has Pleasing OS and UI combination
@ Anita Sony Xperia Z3 Water Proof Sensational smart phone!!!
@Naveen Sony Xperia Z3 Yes it is stunning when viewed straight 
@Geeta It's basically faster than you'll ever need…………..
@Anita Sony Xperia The small apps feature is a wonderful addition
@###,..Sony latest model Fantastic Phone!
@Fin Sony simply Wow!
@Naveen Sony the Best phone I've had with an EXEMPLARY and STYLISH model
@Suma build POWERFUL quad core processor
@Veeresh Superb camera quality
@Vinay Sony mobile Becomes EXCESSIVE HOT during use
@Suma Sony Handset quickly becomes smeared mess
@Anita Sony mobile Disappointing battery life
@$$$ Sony Xperia Z3 Stunning but with minor flaws
@Fin Sony’s Glass panel at the back scratches easily
@Geeta Sony’s Flaps covering headphone and usb ports are annoying
@Santhosh The battery of Sony got so hot whilst watching a film, that the screen cracked.
Test Case 1- @Sans Build quality of Sony Xperia Z3 is stunning, its waterproof and the attention to detail is
exemplary.
Test Case 2- @Aks Sony Xperia is average in lookwise, battery becomes hot soon and found flaws when I used it
*C1-Positive, C2- Negative, C3- Neutral
Filtering
• Execute select query to select Msg from the Msg table.
• Store Msg in a string
• Elimination of Special characters
• Eliminating all non-letter characters
• Split the Msg with white space and store that in an
array
• Removal of Stop words
• Applying Stemming algorithm.
• Array generated is acting as an input for the function in
the next section.
Sample Stop words and Stemming
words
Sample data set after preprocessing
Table 2: A Sample Tweets After Pre-processing & Assignment of
Labels to them
Sample tweets collected from Twitter account for Sony Labelling
brand information
sony xperia is beautiful inch full hd display C1
sony mobile sleek, strong, waterproof design C1
sony xperia has pleasing os and ui combination C1
sony xperia water proof sensational smart phone C1
sony xperia yes it is stunning when viewed straight C1
its basically faster than youll ever need C1
sony xperia the small apps feature is a wonderful addition C1
sony latest model fantastic phone C1
sony simply wow C1
sony the best phone ive had with an exemplary and stylish model C1
Build powerful quad core processor C1
superb camera quality C1
sony mobile becomes excessive hot during use C2
sony handset quickly becomes smeared mess C2
sony mobile disappointing battery life C2
sony xperia stunning but with minor flaws C3
sonys glass panel at the back scratches easily C2
sonys flaps covering headphone and usb ports are annoying C2
the battery of sony got so hot whilst watching a film that the screen cracked. C2
Test case 1- build quality of sony xperia z3 is stunning, its waterproof and the attention to detail is exemplary. ?
Test case 2- sony xperia is average in lookwise, battery becomes hot soon and found flaws when i used it ?
*C1-Positive, C2- Negative, C3- Neutral
Term Document Matrix in more specific way
Table 3 Token from all Documents (+ve, -ve & Neutral) with their MI values (>=0.08 Highlighted)
Tokens MI Values Tokens MI Values Tokens MI Values Tokens MI Values
Sony 0.049682 Waterproof 0.081348 Its 0.077425 Whilst 0.081348
Mobile 0.021202 Sensational 0.087425 Quality 0.086263 watching 0.071348
Disappointing 0.088030 Smart 0.077425 Clarity 0.077514 Film 0.071348
Battery 0.054707 Phone 0.072065 Exemplary 0.08803 headphone 0.071348
Life 0.032803 Sleek 0.087425 High 0.077514 becomes 0.072065
But 0.036940 Strong 0.087425 Price 0.077514 annoying 0.081348
Camera 0.082796 Design 0.077425 Build 0.087514 Smile 0.081253
Is 0.066886 beautiful 0.08803 In 0.077099 Too 0.077425
And 0.077538 Inch 0.087425 Are 0.032803 superb 0.081348
Stunning 0.088109 Full 0.077425 Easily 0.032803 excessive 0.087425
Looks 0.050656 Hd 0.077425 Core 0.087514 During 0.077425
Comparative 0.073829 Display 0.077425 Bad 0.052796 Use 0.077425
To 0.073829 Best 0.081348 Handset 0.071348 Flaps 0.077425
Problem 0.083829 Had 0.071348 Gets 0.077425 covering 0.077425
It 0.073829 An 0.071348 Stuck 0.077425 Usb 0.077425
Screen 0.040423 Stylish 0.081348 Smeared 0.087425 Ports 0.077425
So 0.039034 Model 0.081348 Xperia 0.03803 That 0.077425
Powerful 0.083829 scatches 0.087425 With 0.03803 cracked 0.087425
Pleasing 0.083829 Simply 0.077425 Minor 0.077514 Mess 0.087425
Faster 0.087514 Wow 0.087425 Flaws 0.087514
Wonderful 0.087514 Of 0.071348 Consuming 0.077514 Hot 0.110941
Fantastic 0.087514 Got 0.071348

You might also like