QA User Training

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 37

Polarion Training

(rev. 11)
http://www.polarion.com

QA User Training

Welcome to Your Polarion Expedition

We are happy to have you on board. Before you start have a look at the "how to use this training"
section to understand the basic usage of this document.

1 How to Use this Training

Topic Description

Instructure Lecture Here you will find links to slides used by the instructor for the training session.
Following symbols are used little change

= Link to slide set used by the trainer (online only)


= Link to tutorial video available on http://www.polarion.com/resources/index.php?cat=tutorials
= Link to Polarion Help (online only)
= Link to configuration page in Polarion (online only)

Student Exercises Step by step exercise to understand each feature in detail

2023-03-12 02:42 1 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

2 Table Of Content
1 How to Use this Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

2 Table Of Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

3 Polarion Fundamentals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

3.1 The Polarion Portal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

3.1.1 Instructor Lecture and Videos . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

3.1.2 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

3.2 Understanding Work Items . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

3.2.1 Instructor Lecture and Videos . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

3.2.2 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

3.3 Work Items - Communication and Collaboration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

3.3.1 Instructor Lecture and Videos . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

3.3.2 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

3.4 Understanding LiveDocs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

3.4.1 Instructor Lecture and Videos . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

3.4.2 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

3.5 Traceability and Consistency . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

3.5.1 Instructor Lecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

3.5.2 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

3.6 Search and Queries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

3.6.1 Instructor Lecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

3.6.2 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

3.7 Polarion LiveReport & Wiki . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

3.7.1 Instructor Lecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

3.7.2 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

4 Polarion QA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

4.1 Before we start . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

4.2 Author Test Cases and Test Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

4.2.1 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

4.2.2 Instructor Lecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

4.2.3 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27

4.3 Coverage and Traceability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28

4.3.1 Instructor Lecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28

4.3.2 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28

4.4 Plan and Reuse Test Cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31

4.4.1 Instructor Lecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31

4.4.2 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31

4.5 Executing test cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

4.5.1 Instructor Lecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

4.5.2 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34

4.6 Excurs: Test Automation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36

2023-03-12 02:42 2 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

4.6.1 Instructor Lecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36

4.6.2 Student Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37

2023-03-12 02:42 3 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

3 Polarion Fundamentals
Using Polarion will allow you to manage and control your project data in an easy way. Now it is time to understand the basic
principles of how information can be tracked within Polarion

work items
documents
wiki pages

Hint: Some screenshots of these trainings might differ a little bit from your version but only if
their meaning hasn´t been changed.

3.1 The Polarion Portal

3.1.1 Instructor Lecture and Videos

- http://www.polarion.com/video/tutorials/portalintro/
- http://www.polarion.com/video/tutorials/projects1/
- http://www.polarion.com/video/tutorials/projects2/

3.1.2 Student Exercises

MP-3925 - Create Your Own Playground Project


You will use your playground project for all exercises throughout this training

Select "Create New Project"

click next and add following project data


Name = [Your Project Name]
TrackerPrefix = FUN
Create a new project in Sandbox/[Your Project Name] using following template

Open Project Home Page

MP-3941 - Get familiar with the Polarion Portal


2023-03-12 02:42 4 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

You will use your training project for all exercises throughout this training.
Familiarize yourself with your Polarion Portal e.g.:

Open your training project if not already opened


Open your personal home page
Open your project home page
Navigate through your project using your project home page as start point
Open your Work Items
Explore the different Work Items Views
Use different layouts for your panes
Activate and deactivate Lite Form
Open Documents & Wiki
Expand your Navigation Bar
Use "Save as Shortcut" - What happens ?

MP-2824 - Configure Your Account


Your personal homepage "My Polarion" gives you direct access to the configuration of your account. Only users, which belong
to the global role "assignable" or to project role "project_assignable" are allowed to become an assignee for work items.

Open your personal homepage "My Polarion"

Click on "My account"

Check that you have role "project_assignable", "project_admin" and "project_approver" in your Polarion training project. If
not please add the mentioned roles.

2023-03-12 02:42 5 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

3.2 Understanding Work Items

3.2.1 Instructor Lecture and Videos

- http://www.polarion.com/video/tutorials/browsewi/
- http://www.polarion.com/video/tutorials/linkroles/
- http://www.polarion.com/video/tutorials/traceability/basic/

3.2.2 Student Exercises

MP-2613 - Create your first work item


Typical examples for work items are tasks. Tasks are helpful to track planned activities. Tracking tasks will ensure that you
have a common understanding on all activities in your team.

Create a new task "gather requirements for our project"


Add yourself as assignee to the task
Add an initial estimate of 2 days (2d) to the task
Add a hyperlink to: http://en.wikipedia.org/wiki/Activity_(project_management)
Add a funny image using copy & paste (CTRL + C and CTRL + V) in your work item description
Add a simple Use-Case diagram using the internal diagram editor

MP-2616 - Create a follow-up task

Open the task "gather requirements for our project" and create a linked follow up task

Add following information to the task


2023-03-12 02:42 6 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Title: "bring me a cup of coffee when finished ;-) "


Add yourself as assignee to the task
Create the work item

MP-2617 - Change status of a work item

Open the task "gather requirements for our project"


Change the status to in progress by performing the action "Start Progress"

Save the work item

2023-03-12 02:42 7 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

3.3 Work Items - Communication and Collaboration

3.3.1 Instructor Lecture and Videos

- http://www.polarion.com/video/tutorials/comments/

3.3.2 Student Exercises

MP-2614 - Find your activities and comment on them


In your personal homepage you can find your basic todo list containing all activities and work items which have been assigned
to you. Open a work item to comment on it or use the activity stream to comment on latest by your team members

Open your personal homepage "My Polarion"

Click on the task "gather requirements for our project" to open the work item
Add following comment "what template shall I use to gather the requirements ?"

Save the work item

3.4 Understanding LiveDocs

Polarion LiveDocs are shared documents which typically contain work items like requirements, test cases or tasks. Also the
document you are currently reading is a Polarion document containing exercises work items. Documents are the best way to
start capturing project data as it is intuitive and easy to use.

3.4.1 Instructor Lecture and Videos

- http://www.polarion.com/video/tutorials/workwithdocs/
- http://www.polarion.com/video/tutorials/reuse-docs

3.4.2 Student Exercises

Understand how Polarion LiveDocs can be used to track meeting minutes in a very easy way.
MP-2608 - Create Meeting Minutes Document Template

Create a new space Meetings by opening Documents & Pages and clicking the plus icon as vizualized in screenshot
below.

2023-03-12 02:42 8 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Create a new document Meeting Template


change Work Item Type to: task

Add headings level 1 for:


Agenda
Participants
Action Items
Save the Document

2023-03-12 02:42 9 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

MP-2827 - Create Meeting Minutes Document

Click on the gear icon inside of the document

and click Reuse to create a new Meeting Document with name: User Training Meeting Notes [date]
Select Space "Meetings"
Check: Remove outgoing Work Item links
Uncheck: Link duplicate to original

2023-03-12 02:42 10 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Change document title to User Training Meeting Notes

Hint: Try out following options:

Create at least two new tasks


Create at least one child task by pressing the tab button.
Open Work Item Properties

and add responsible person (if needed change pane settings to show assignee)
Configure your document that the assignee is shown on the document
Move and delete tasks
Add a "relates_to" link between two tasks using the link symbol next to the task icon
Try Recycle Bin and document Comment

Hint: Use your document Training Meeting Notes to take notes during your training

MP-2609 - Create Favorite for your document "User Training Meeting Notes"

Ensure your document "User Training Meeting Notes" is selected in your navigation bar.
Click on "Save as Shortcut"

2023-03-12 02:42 11 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Add your preferred title and icon for your favorite. Ensure type is set to "Favorite":

MP-2618 - Using document templates


Templates will increase reuse and quality within your projects. Build templates for checklists and guidelines to ensure that
project relevant data is tracked.

Open the document library project and browse through the available templates

Open one of the templates e.g. Software Test Plan and Reuse Document

2023-03-12 02:42 12 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Enter necessary data in the reuse document dialog window


Provide a new name for the document "Software Testplan ELibrary Release 1"
Select your project and select "Testing" space.
Uncheck "link duplicate to original"
Attention: If you create documents based on existing templates traceability is usually not necessary
Verify that your project now contains the document "Software Testplan ELibrary Release 1"

2023-03-12 02:42 13 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

3.5 Traceability and Consistency

To ensure that all information in the project is kept in sync you can use the suspect features to mark work items which need
review

3.5.1 Instructor Lecture

- http://www.polarion.com/video/tutorials/traceability/basic/

3.5.2 Student Exercises

MP-3988 - Create a follow-up task

Activate the Polarion tracker by clicking on Work Items in your Navigation Bar
Create a new task and name it "use links to keep traceability and consistency"
Add yourself as assignee
Create a "relates_to" link between your new task and the task "gather requirements for our project"

Save your link

MP-2831 - Propagate, Check and Remove a Suspect


Whenever you change the meaning of a task or another work item you should consider a suspect.

Open your task "gather requirements for our project"


Add to description "We need to create a requirement work item for each requirement in our project."
Select "save and suspect" or if you edit the task within a document go to document properties and turn auto-suspect "on"
Open shortcut "My Suspect Work Items"

2023-03-12 02:42 14 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Hint: Suspect work items are also displayed on your personal home page

Open each suspect task and check if an update is needed


Use work item comments to track your changes
Update task and remove the suspect

2023-03-12 02:42 15 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

3.6 Search and Queries

Polarion's search and query feature will help you to find information easily. It will allow you to concentrate on the relevant data
needed for the next process step by filtering out all unnecessary information. Typical examples are:

Show all requirements which are ready for review


Find all defects assigned to me
Show all requirements in a specification document which are still in draft

3.6.1 Instructor Lecture

- http://www.polarion.com/video/tutorials/search/
- http://www.polarion.com/video/tutorials/advancedsearch/

3.6.2 Student Exercises

MP-2620 - Find work items assigned to you


Work items which have been assigned to you represent activities (tasks) which should be accomplished by you, or content for
which you take responsibility (requirements, test cases, defects ...).

Select Work Items in your Navigation Bar


Display all work items assigned to you using a appropriate query

Create your personal shortcut for above query and name it "My Work Items"

Change the status of your task to in progress by invoking the action "Start in progress"

MP-2607 - Perform some ad-hoc searches


As not all search possibilities are available as predefined searches it is essential to be familiar with Polarion's search and query
feature.

Find all work items which have been assigned to you by using a predefined shortcut "My Work Items"
Change the scope of the search to

2023-03-12 02:42 16 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Tasks only
Work items within User Training Meeting Notes document

Hint: If you are using the query builder to search for work items in a specific document you must
follow a specific syntax. All documents are uniquely identified by "space name/document name" and if
the document name or space name contains spaces you need to add "" at beginning and end.

Work Items in the whole repository


Use quick search to find all topics which contain the word "test" in your project.
Use deep search to find all documents, items and wiki pages which contain the word "requirement" in your project.
Search with standard wild cards
* | any character can follow
? | this character can be replaced by any other character
Search with advanced wild cards
Support of advanced wildcards like ~
For example: "business~"

MP-2621 - Save your search for later reuse


In many cases you will want to reuse a query multiple times. In such cases it is useful to save the query.

Build a query with "bad" words like "easy fast quick modern..." and save it as project query with the name "bad words"

2023-03-12 02:42 17 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

3.7 Polarion LiveReport & Wiki

Wiki pages are very helpful for creating reports or when you need to guide the end user through a defined process.

3.7.1 Instructor Lecture

- http://www.polarion.com/video/tutorials/wikiintro/

3.7.2 Student Exercises

MP-2610 - Create your first wiki page


Personal wiki pages allow you to display and link information you are interested in

Create a new page [your Name]_Home in "Default Space" e.g. "Tim_Home"


Add title and content:
title: My Wiki Page
text: This is my cool wiki page especially for me
Add following subheadings
My favorite Links
Open tasks
Unscheduled Items
Action Items
Add a link to project home page using wiki link [Home]
Change the link so that it is written "goto home page" using an alias
Add a link which displays all items assigned to you. To achieve that copy the URL which displays your workitems into the
wiki page.

MP-2611 - Show work items inside wiki pages

Display all open tasks using the {workitems} macro under "Open tasks" heading
/polarion/wiki/bin/view/page/Doc/SyntaxHelp#HWorkItems
Display all items which are unassigned using the {workitems} macro and the "queryName=Unassigned" attribute
Display only id,title,assignee and status using the fields attribute
Change the visualization of the query using the display=list attribute
Now we want to add our action items to our wiki page by using the root attribute. To display only the section Action Items
you need to provide the ID of the heading item as value of the root attribute.
/polarion/wiki/bin/view/page/Doc/SyntaxHelp#HDocuments
For example: {document-workitems:name=Meetings/User Training Meeting Notes|display=document|root=FUN-17}

Change the visualization to tree using the display=table attribute

2023-03-12 02:42 18 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

MP-5531 - Create a new Rich Page report


In one of the previous excercises you have created a Classic Wiki Page. For people who don´t use to work with wiki pages and
their scripting language we might want to have an easy way to create reports.

Goto Documents & Pages


Create a new LiveReport page by clicking plus icon top left
Add title and space for your LiveReport (name will be set automatically):
Title: Task Overview
Space: Meetings
The layout has three regions by default. The first region should be used for title and description.
Add Table - Block widget into second region (left region) and add a Separated by - Pie Chart widget into the third region
(right region).

Add a description for your Rich Page into your first region:
"This report gives you an overview about your tasks in this project. These tasks are separated by status"
Setup Table - Block Widget
Select only Task Work Items
Remove column Severity
Add column Assignee
Sort by Status
Setup Separated by - Pie Chart
Add chart title Task by status
Select only Task Work Items
We want to separate by Status

Hint: To visualize changes made in widget sidebar you need to click "Apply"

MP-2606 - Show open tasks on top of your meeting document

Open User Training Meeting Notes and place your cursor at the location where you want to see the open tasks of last
meetings
Insert Wiki Content

2023-03-12 02:42 19 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

and add {document-workitems:name=$page.space.name/$page.name|query=type:task AND status:open|display=table}


macro which displays all open tasks in this document
Try following macro as alternative
{workitems:query=document.id:$page.space.name/"$page.name" AND type:task}
Add macro to your document template also

2023-03-12 02:42 20 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

4 Polarion QA

4.1 Before we start

MP-5218 - Enable Test Runs topic in project


By default test runs are disabled in our Software Specification project. Before we start we need to enable this topic in project
administration.

Open Administration > Portal > Topics > Edit default Topic configuration
Add "testruns" as topic

Save configuration and verify Test Runs are available in Polarion UI

4.2 Author Test Cases and Test Specifications

4.2.1 Student Exercises

MP-2746 - Track test cases as work items


Polarion comes with pre configured templates that define work items by individual fields arranged in various containers, such as
the core information, Description, Comments, etc. Each of the containers can contain as many fields as are necessary to
define the work item as your business rules dictate. In addition to the fields that are already available, custom fields can be
created to appear in any container available in the work item. Additional containers can be created as are needed.
Create your first test case using work item type "Test Case"

Title: Login should be case sensitive


Severity: Smoke
Add following content as description:
We need to verify our login is case sensitive for username and password
Precondition: Supported browsers installed (Firefox, Internet Explorer, Chrome), login credentials available
Postcondition: n/a
Mockup:

2023-03-12 02:42 21 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Hint: You can insert images by using CTRL+V if you have copied an image into
your clipboard. You can also manually upload images by using upload button in
your description

Test Steps:

Step Step Description Expected Result

Login screen Open login screen via Website should appear to enter user credentials (see
browser mockup)

Login name Use login name "Admin" Username should be visible as cleartext

Login Use password "admin" Password should not be visible as cleartext


password

Login Click login button Login should not work

Hint:
- You can use your TAB / Shift+TAB key to navigate through your tables.
- To indent data you press Shift-Alt-Left/Right Arrow
- You can also copy and paste data using Alt+C / Alt

Assign test case to current user


Write comment:
"Writing a test case like this is not very efficient because I need to test several brwosers, usernames and passwords. So I
need to work with lots of copies."
Save test case

MP-5546 - Adding Test parameters to previous test case


In manual testing, it is common for the testing steps of a test case to be executed multiple times with variations in the test
procedure. For example, the same set of steps might be run on desktop and mobile operating systems, and/or with different
browsers on the different operating platforms, or an electromechanical component might be tested with different input voltages.
Polarion’s Test Parameters (or “Parameterized Testing”) feature can help make the test specification process efficient and
flexible.

2023-03-12 02:42 22 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

One way to test our previously created test case in several browsers or username/password combinations would be to create
duplicates of this test case but as already said this is not really efficient.

Open test case Login should be case sensitive


Replace following test step content with parmaters (parameter id in brackets) browser(browser), "Admin"(username),
"admin"(password)

Add parmaters to library so we can use them later during test planning.

Resolve previously created comment


Change status to Active
Save changes

MP-5547 - Create a new test specification


Create a new document and add two new requirements

go to Documents & Pages | Specification| Index and create a new LiveDoc document

Document name: QA_Elibrary Test Specification.


Type: Requirements Specification
The document should contain test case work items and the prefix should be QA.

2023-03-12 02:42 23 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Hint: We are using as document type Requirement specification because if we would


like to use the document workflow of this document type. It is also possible to define a
workflow for test specifications. This is not necessary for our exercises. How document
workflows can be setup is part of Polarion´s Power User training. (The current
requirement workflow is not working for test specifications because of condition
checks.)
How document workflows and signatures work is part of Requirements User training.

MP-5548 - Configure your test specification


It is possible to configure how and what data is visualized in a LiveDoc. By default your work item data is shown with description
only. Additionaly an unique ID is shown in front of your items and their status at the end of each item

Change content to: Title, Description and Test Steps

You can define which fields should be visible by default for a user.
Change fields at start to: Outline Number
Status, Severity and Test Type should be shown in the document properties pane on the right side. Severity and Status
should additionally be shown at the end of a Work Item.

2023-03-12 02:42 24 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Hint: The Select Fields dialog can also be invoked via the gear (Pane Settings) icon in the
Work Item Properties sidebar (enabled when a Work Item is selected in a Document). When
invoked from there, the fields configuration can be saved as a user-specific personal
configuration only for the current user, or as the default for the Document.

MP-2750 - Add test cases to specification

Add following three new test cases and save the document (you don´t need to enter valid test steps for all test cases)
Is user able to search for books
Is user able to lend books
Is user able to manage a book favorites list

2023-03-12 02:42 25 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Create following two sub test cases below the test case "Is user able to search for books" (TAB button)
Are wildcards supported in search
Is it possible to search in all book fields
Fill table for test steps of sub test case "Is it possible to search in all book fields" with following steps
Open Search perspective
Search for author
Search for ISBN number
Search for price

Now Move your existing test case to specification

Search for test case "Login should be case sensitive"


Select work item action menu and move work item to your user specification "QA_Elibrary Test Specification"

At the end Change severity of all Test Cases to Basic

use bulk edit in tracker view to change severity of all test cases inside of the specification to "Basic"

4.2.2 Instructor Lecture


- Microsoft Excel Integration
- http://www.polarion.com/video/tutorials/excel-import/

- Excel Import

2023-03-12 02:42 26 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

4.2.3 Student Exercises

MP-4848 - Importing an Excel Spreadsheet


In many cases you will receive a specification in form of an excel document. In this case you will need to extract all relevant test
cases out of the document and manage them as separate test cases.

Go to Work Items|Operations|Import|Format: Microsoft Excel Workbook


Choose Import File provided to you or found on Home
Import as new document named "Test Specification" in space "Specification"

Apply following settings

Hint: You can also import multi valued fields e.g. "Release". See help for more information.

MP-3003 - Using Excel Round-trip

Change Work Item scope to test cases


Click on the gear icon at the upper left and select "export"

As format choose "xlsx:Microsoft Excel" and as template "Basic"


Now you have to select all attributes which should be exported to an Excel document to collaborate with an
external stakeholder which has no Polarion. Select columns ID, Title, Description, Type and lock these attributes if
there isn´t already a lock icon by clicking at the end of the attribute field.
Now select severity as exported attribute and unlock this field. After clicking OK you will get an exported Excel file.

2023-03-12 02:42 27 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Open this file and verify that all fields which were locked aren´t editable.
Change severity of all test cases to "basic" if they aren´t basic yet.
Reimport changed Excel sheet by clicking on the gear icon another time and select "import".
As format choose "xlsx: Microsoft Excel Round-trip Changes" and select the exported file.
Click on "Start" and if successful you will get a summary which files were changed.

Verify that all changes are correctly reimported to Polarion.

4.3 Coverage and Traceability

4.3.1 Instructor Lecture

- http://www.polarion.com/video/tutorials/traceability/basic/

4.3.2 Student Exercises

MP-2751 - Link Testcases with requirements


In order to meet project or product deadlines you must be able to have a cohesive system that allows all stakeholders to work in
real time. If stakeholders are working in silos the time to market or the ability to fix a defect can be more time consuming which
will lead to delays. A way to deal with this is to provide complete forensic traceability so that all requirements are linked to a test
case. Having requirements linked with test cases will keep your product managers, developers and QA stakeholders all in sync
and doing so in real time so that deadlines and goals are met.

Create a "verifies" link from example requirement "Some functional requirement representing a system feature. Itemize
the detailed..." to test case "Login should be case sensitive"
Attention: Click on the start link icon of "Some functional requirement representing a system feature. Itemize the
detailed..." click on the link icon of "Login should be case sensitive" select link role "is verified by" and save your
changes.

2023-03-12 02:42 28 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

MP-2755 - Create a testcase from a requirement


While focused on any Work Item, you can quickly create a new Work Item and a link, all in a single operation.

Select example requirement "Some functional requirement representing a system feature. Itemize the detailed..." and
click on the plus symbol below the requirement
Select "Veryfing Test Case" and create a new linked Test case "This is an example Test Case"

Hint: Polarion has lots of traceability reports available but own reports can be customized.
Checkout some out of the box reports and verify all of them show the correct results:
- Test Case Traceability
- Requirements Test Coverage
- Traceability Report
- Work Item tree view

Additionally Polarion has a matrix view which can be used to link Work Items to each other but
this view is not pretty handy. Just to ensure you also know this view open this view and filter for
requirements and test cases.

2023-03-12 02:42 29 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

MP-2761 - Update a test case on a changed requirement


All requirments are covered by your test cases, but what happens when the requirments are changed? Keep your project data
consistent by working with suspects. In the previous exercise we linked 2 test cases to our requirement "This is a sample of non
functional requirement", now we make some changes to this requirment and create a suspect link.

Search for requirment "Some functional requirement representing a system feature. Itemize the detailed... " and add
following text to description: "This is an example for suspect links"
Now save this requirement as suspect to mark all linked test cases as supect linked work items.

Open your personal homepage "My Polarion" and you will see all potential change impacts.

Open each suspect test case and check if an update is needed.


Update the test case and remove the suspect by unmarking the suspect flag in the link section of our test case

2023-03-12 02:42 30 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

4.4 Plan and Reuse Test Cases

4.4.1 Instructor Lecture


- Test Planning
- http://www.polarion.com/video/tutorials/testmanagement/overview/

- Managing Test Runs

4.4.2 Student Exercises

MP-2763 - Using document templates


Templates will increase reuse and quality within your projects. Build templates for checklists and guidelines to ensure that
project relevant data is tracked.

Open the document library project and browse through the available templates

Open Test Plan and select the Gear icon and click on Reuse

Enter necessary data in the reuse document dialog window


Provide a new name for the document "Testplan Elibrary Release 1"
Select your project and select "Testing" space.
Uncheck "link duplicate to original"
Attention: If you create documents based on existing templates traceability is usually not necessary
Verify that your project now contains the document "Testplan Elibrary Release 1"

Hint: In this exercise a test plan is a LiveDoc. This is a good practice but usually Polarion
Test Runs are also used for Test Planning.
Some customers are also using a special work item type for test planning.
So in generall there are 3 good practices which one is the best for you depends on your
process.

2023-03-12 02:42 31 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

We have imported some test cases which are not yet approved or at least reviewed. Usually these would be our steps before
executing these test cases. We will skip these steps so we also need some test cases which can be executed. We already have
a test specification in our Elibrary project which can be reused for this project.

Open the Elibrary project and reuse "User Acceptance Test Specification" so we have this specification in our project.

Hint: If you want to know how to review and approve check our Requirements User Training.

MP-2764 - Reuse test cases and test scenarios


Usually you won´t develop test cases and test scenarios only for one test run. By developing your product you are going to
retest your product again and again, so called regression tests. We want to reuse our test cases with severity "smoke" inside a
test scenario so called test run.

Goto Test Runs and click "Create" at the upper left


Create 2 test runs "i1_SmokeTest_Team A" and "i1_SmokeTest_Team B" and select "Smoke Test" as template
After creation you should have 2 test runs which are also test reports for our management

You have created 2 similar test runs with the same test cases. Next step will be to assign these test runs to a testing team by
creating a test plan.

MP-5549 - Create a parameterized Test Run


In exercise MP-5546 - Adding Test parameters to previous test case we´ve created a test case and configured some
parameters to test a similar scenario with different parameters. Now while planning our test run we want to fill these
parameters.
These parameter values can be added for Test Runs, Test Run templates and also during selection of test cases.
We are going to define the value for a browser directly in a test run (usually the parameter is added in a template and the
values are added to the run, see also screenshot) , username and password will be defined during test case selection.
Attention: If you create a test run out of the template called "Empty" you can select your test cases manually without any
query.

Create a third test run called "i1_LoginTest_Team C" and select "Empty" as template
Open test run properties and select parameter browser. Add parameter browser and set value e.g. Firefox 40 (image is
just an example so it might differ from your view)

2023-03-12 02:42 32 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Save changes of your configuration and go back to test run frontend.


Click on Actions-> Select Test Cases to select your test cases.

Select test case Login should be case sensitive


Due to your test run parameter configuration the browser field should already be filled. Username and password should
still be empty. These can now be filled. (image is just an example so it might differ from your view)

Add
1st iteration with username: Admin password: Admin
2023-03-12 02:42 33 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Add 2nd iteration with username: Admin password: notworking


Add 3rd iteration with username: robert password: Admin
Save Test Run

MP-2765 - Create an overall test plan


We have already created a test plan by reusing a document out of our document eilbrary. Now we want to assign our test runs
to our testing teams.

Goto Documents & Pages | Testing | Test Plan


In chapter 5.2 you will find a task "Execute test A"
Change task name to "Exceute test run i1_SmokeTest_Team A", copy link of test run "i1_SmokeTest_Team A"
and paste it into task description and assign task to yourself
Add 2 additional tasks below and repeat the steps only for test run "i1_SmokeTest_Team B" and
"i1_LoginTest_Team C" and assign these aswell to yourself.
Verify if tasks are assigned to you in your "My Polarion" dashboard

4.5 Executing test cases

4.5.1 Instructor Lecture

4.5.2 Student Exercises

MP-2766 - Executing test cases online


First part of our test execution will be online testing inside of Polarion.

Select test run "i1_SmokeTest_Team A" and Perform action Start Progress by clicking Test Run status button on top
right.
This will indicate to other users this Test Run is currently in testing.
Now click on "Execute test"

You will see a list of all test cases which are not yet executed. Read all test step and let´s say this test passed, so click
on the "Passed" button for all test steps and this test case.

Hint: For each Test Run type defined, it is possible to require electronic signature when
executing Test Cases in Test Runs of the type. For example, if you have a type, "Manual
Security Test", you can configure it to require a signature when executing Test Runs of
that type.
By default Test Runs of Type "manual" have elctronic signatures enabled so you need
to enter your login credentials for each executed test case.
This signature can be disabled in project administration. How this can be configured is
part of Polarion QA admin training.

Polarion will select the next tast case. Write into the comment field on the left which test step failed, add an attachment
and set test case to "Failed"

Hint: If you don´t want to switch automatically to the next test case disable the checkbox displayed at

2023-03-12 02:42 34 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

the picture below.

Let´s see which tests are already done. Go back to the last test run and review how our test run report changed.

Hint: Some regulations require to track each result of a test step manually. It is not enough to record only
that a test step has passed successfully.
This causes immense overhead as a tester needs to repeat all for the same test case in different test runs
the same result over and over again
Polarion gives the possibility to reselect previous results of a test step execution during test execution.

MP-2767 - Executing test cases using excel


On our second part of test execution we will test offline. You will not always have an internet connection to your Polarion server
but you should be able to test offline. Polarion delivers an offline testing solution you should already know. An export to MS
Excel which exports our test cases and a reimport of our test results.

Goto our test run "i1_SmokeTest_Team A" and click on "Export Tests to Excel" below the "Execute Test" Button we use
before.
Now you will get an Excel file with all remaning test cases. You should recognize this sort of Excel file. It is similar to our
Excel Round-Trip file. You can only change test results and add some comments to these test cases. Repeat the working
steps you did before in Polarion. Set one test case to passed and one to failed. Don´t forget to write a comment why one
of the test cases failed. We need this comment for our next step.

After testing offline we can reimport our file to Polarion by clicking "Import Results from Excel" below the export button.
Review how our test run report has changed.

2023-03-12 02:42 35 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

Hint: Similar to online execution of test cases, electronic signatures are also activated
for offline execution. So during import of your test results you wil be asked to add your
credentials.

MP-5550 - Recent execution and test paramters

Execute i1_SmokeTest_Team B online (change status as previously done to "In Progress") and use recent button to
reuse execution details from your previous test run.
Execute i1_LoginTest_Team C (change status as previously done to "In Progress") and check if your parameters work as
expected. Please let at least 1 iteration of your login screen test fail.
Review your test run i1_LoginTest_Team C and check what kind of data is stored in your defect.

Hint: Test parameters can also be exported for offline execution.

MP-2768 - Tracking defects for failed test cases


If you haven´t already seen, Polarion delivers a fully integrated defect tracker aswell. In our current test run we should already
have 2 defects linked to our failed test cases. These defects were automatically created after our test cases failed. The title of
the defects are resulting to the test case name and the comment we have written into the test case comment field is displayed
in the description of the defect together with a link to the test run

Open one of the defects and let´s say this defect is fixed
Change status of this defect to "Verified as Done" by using action "Perform action Mark Verified Done"
Set Resolution field to "Done"
Select time point "Version 1.0"
Assign yourself to this defect
If you review our test run another time you will see the defect is striked through.

MP-5580 - Test Run Workflow


A test run and its reporting function is a perfect way for a manager to have an overview about the test runs and their current
status.
Polarion can also support formal testing review and sign-off process for Test Runs, using secure electronic signatures
compliant with U.S. 21 CFR Part 11. An administrator can map the organization's review and sign-off process to the Test Run
Workflow configuration. Each step in the process can optionally be set up to require an electronic signature before a Test Run
can move to the next stage in the workflow.
If you have completed all your test cases of your test run set your test run to "Passed" or "Failed" by clicking the button on the
upper right.

4.6 Excurs: Test Automation

4.6.1 Instructor Lecture


- Automated Testing triggered by nightly builds
- Developing With Polarion
- http://www.polarion.com/video/tutorials/repobrowser

- Integrating with external testing tools

- Polarion for Developers

2023-03-12 02:42 36 | 37
Polarion Training
(rev. 11)
http://www.polarion.com

4.6.2 Student Exercises

MP-2770 - How to integrate with test automation tools


Most organizations are testing their unit tests with special testing tools and need to generate some reports and statistics for
their managers,
Polarion delivers an importer which can handle a xUnit file output of such automated testing tools.

Create a new test run called "auto_Product A" and choose "xUnit Test Manual Upload" as template
You will get a new test run which looks nearly like other test runs we already now. Use the "Upload Results" button to
upload the file manually. Usually you would create a job which will import these files automatically.

Use your selenium test results file stored at Home to upload your results.
After uploading your test report will be generated and all test cases and defects which are new will be created, Test
cases which are already available will be updated.

2023-03-12 02:42 37 | 37

You might also like