Professional Documents
Culture Documents
Mobile Handset and Mobile App Testing: Session For Test Management Cop Session For Test Management Cop
Mobile Handset and Mobile App Testing: Session For Test Management Cop Session For Test Management Cop
Disclaimer
The contents of this deck and the session conducted for TMCoP leverages iGATE Patnis past experiences in this space Research references from Industry Research firms Individual opinion and research conducted on this subject over a period of time This is not a snap-shot of iGATE Patnis capability in Mobile Testing For any comments and queries regarding this presentation please contact kapil.chourasiya@igatepatni.com
-2-
Worldwide 2011 Q2 Smartphone sales by Operating System - Gartner Market Share Handset Makers ( mn units 2010) : Strategy Analytics 2011
Others, 413.8
Nokia, 453
Samsung, 280.2
Mobility Landscape
Enterprise Systems
Legacy
Applications
SFA/FFA
Distribution/Retail
Management Dashboard
Patient Monitoring
Credit Card/Claims
Middleware/ Platforms
Rhomobile
Broadbeam/ Mobileaware
LAN, PSTN, DSL, GSM, GPRS, CDMA, CDPD, UMTS, WLL, WiFi, Satellite
OS/ Platforms
Mobile Devices
PDA
Smartphones
Mobile phones
Rugged Terminal
POS/ Tablets
Laptop
Peripherals
RFID reader
Barcode Scanner
Camera
Printer
Sensors
GPS Receiver
-4-
Applications
Mobility Challenges Real-time, Off-line, Near-real-time Security, Authentication, Authorization Technology Convergence Provisioning and device management Scalability Services Messaging, location based, notification
Complexity of
Middleware
OS
Application Challenges Commercial grade apps Content Aggregation Customizations and personalization Multi-device support Multi-lingual support Application categories
Mobile Devices
Peripherals
Device Challenges Device capabilities Programming models No dominant standard Wide range of target environments
Native Applications
Test Apps that reside on the device and may or may not require network connectivity
Examples New / Upgrade of Handset from OEM directly Co-branded Handset with Telecom Operator
-6-
Types of Testing
Functional Regression Integration Automation Multi-lingual Usability Field / Coverage Quality of Service Performance Testing Security Testing
Focus Areas
The customer in this case could be a Telecom Operator or an OEM for e.g. Nokia
Please note Types of testing highlighted in Italics are not offered as a service in this space by iGATEPatni today
Proprietary and Confidential September 27, 2011
-7-
-8-
TOOLS (calculator,voice memo,stopwatch,etc.) SETTTINGS CAMERA PRE LOADED CONTENTS GAMES HELP & INFORMATION CONTENT MEMORY
CALLS
MEDIA PLAYER (audio and video) LANGUAGE UI (in cases of another language being present like Spanish)
-9-
- 10 -
The customer in this case could be an Enterprise OR a content Provider or an App/WAP provider
Please note Types of testing highlighted in Italics are not offered as a service in this space by iGATEPatni today
Proprietary and Confidential September 27, 2011
- 11 -
Please note This is only a sample list of tools. This by no means is a list of most recommended tools by iGATEPatni in this space
Proprietary and Confidential September 27, 2011
- 12 -
Device Anywhere
All Leading Handset OEM s Android, Blackberry, Windows, Symbian, iOS, Win 7, WebOS Drag drop functionality Ability to script in Java Yes Yes No Built-in Test Case Manager Yes HP QTP and QC IBM Rational Quality Subscription based SaaS* [ 12 mth commitment ]
TestQuest
Android, Blackberry, BREW, UTS, Windows No Scripting Yes Yes Yes Built-in Test Mgr Yes Not available Cost
Perfecto Mobile
Android, Blackberry, Nokia, iOS,
Eggplant
Android, iphone, Symbian, Windows Blackberry Yes Yes Yes No No Yes No Cost
Robotium
Android
Scripting Functional Testing Automation Testing Performance Testing Test Management Remote Connectivity Integration with industry std. tools Licensing Model
* Each package is a collection of devices with some common characteristics such as network (e.g. Verizon Package), manufacturer (Samsung Package), operating system (Android package) etc. Reference Collateral from Individual Websites of respective toolset vendors | These are some of the key features ; however one needs to do a thorough POC to arrive at a recommendation
Proprietary and Confidential September 27, 2011
- 13 -
100 s of real devices / phones connected to live network are installed in their Data centre available for use based on a subscription package (SaaS)
Through the DeviceAnywhere Test Centre a tester can remotely connect to these devices / phones via an https web based connection in real time and can remotely perform any action..
- 14 -
Analyze Requirements
Functional, Automated
NonFunctional
Present Findings
Defect Management
Go Live!
If certifying a common functionality / WAP / APP across devices account for Regression testing of defects across the devices/operating systems/browsers , else you will run out of time during re-tests! Testing report should highlight the features that are working / not working across devices Conduct automation post a thorough ROI calculation only Some tools do not integrate with traditional Test Management and OR defect management tools therefore account for the overhead ( effort and cost ) of managing test cases / defects in a different toolset Defect Management Prioritize defects upfront with the Dev/Vendors and Business In third party testing scenario ( OEM ) account for additional rounds of discussions for defect triage
Case Studies
- 17 -
Virgin Mobile USA Customers Internet Security VMU Web Portal Sales
Handset Plans Promos
Activations
Port In/Out Change MIN/ESN Promos
Help/Self Care
Services Phones VirginXtras
Gateway CRM Distribution Center Billing Credit Card Transactions CDR Telcordia
Areas of Testing
Handset
Functionality Handset Testing User Interface Branding Mobile Phone controls Partner Applications Multimedia and Graphics
WAP
WAP Enabled Application Third Party Applications Third Party Content
Integration
Integration with Mediation Managers Billing system Customer Care system
- 19 -
NOKIA
KYOCERA
PATNI
FLASHING NEW BUILD UNSTABLE END CUTOMER STABLE BUG REPORTING TESTING
- 20 -
Handset Testing
WDIG
HANDSET PORTFOLIO
Offshore
GATEWAY P100 P205
LG200
SCH110
Content Download Family Monitor Family Alerts Family Locator Photo Upload and Download
- 21 -
- 22 -