HPE

StormRunner
Load
Cloud Agile Load
Testing
Vivit : Mid Atlantic User Group
Presenter: Robert Linton
CorTechs, Inc.
VP ALM
Date: April 27th, 2016

© Copyright
1 © Copyright
20142016
Hewlett-Packard
HPE. The information
Development
contained
Company,
herein
L.P.is The
subject
information
to change
contained
without notice.
herein is subject to change without notice.
HPE StormRunner Load
Performance Testing in the Cloud for Web & Mobile
Apps Simple
Design & create load test
under 10 minutes

Smart
Intelligent & predictive
analytics for fast
problem detection

Scalable
1 user to 1M+ Geographically
distributed

2 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
Customer Feedback

3 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
How StormRunner works
Load Generators spin up
Create and run a in AWS EC2 or MS Azure Results and app
1 load test using your 2 3 insights are available
favorite scripting tool in real time

New

© Copyright 2016 HPE. The information contained herein is subject to change without notice.
Soon
4 New
SRL 1.8 – Jan 2016 release

NV Network
AWS Code Dynamic
Dynatrace breakdown
Pipeline ramp up
report

Test from Advanced Custom

View RTS
CSV file scheduling reports
Ice Climber – 1.9 – March release

LR Java
Gatling Vusers license Edit RTS
protocols

Real time Usage Linux OPLG Usability

breakdown reporting (tech preview) improvements
Protocol support
LR Java Edit RTS

Gatling

7
License

License usage report

Cloud or On Prem
VUH or Vusers

8
How it is
Priced

Just Load

9 © Copyright
© Copyright 20132013 Hewlett-Packard
Hewlett-Packard Development
Development Company,
Company, L.P. L.P. The information
The information contained
contained herein
herein is subject
is subject to to change without notice.
change without notice.
Compare TCO - Traditional Costs vs. Cloud Hosted TaaS
Cloud
Typical Hosted
- separate Costs and
Effort All included in ONE
price
• TOTAL COST to Test • TOTAL COST for - DTaaS
• Tool Admin = $ • Tool Admin - included
• Hardware = $ • Hardware - included
• OS , DB = $ • OS , DB - included
• License = $$ • Test Lab Space -
• Lab Space = $ included
• O&M = $ • O&M - included
• C&A = $ • C&A - included
• Outages = $ • SLAs – included
• Training = $ • HP Software Licenses -
• Staff = $$ inc
• Time to run scripts = $ • Test Executions
• Test Reports
• Test results Analysis

10 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Pricing options:

VUser based pricing for testing internal

A applications using own LGs or own AWS New!!
!
account

VUH based pricing for testing from Cloud

B LGs
VUser X Time =VUH

11 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Price in two simple steps:

Type of
1 UI API Dev
VUser

VUser
2 X
Time Virtual Users Hours of test Number of test
runs

=VUH

12 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Define TYPE of VUser

Enables you to run UI level protocols, such as TruClient

UI scripts. Ideal for lower volume load tests with precise UI
emulation and less scripting time
STE
P API Enables you to run network level protocols, such as
Web(HTTP/HTML). Ideal for Large volume load tests.

1 Dev
Enables you to run third party protocols, such as JMeter

13 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Price in two simple steps:

Type of
1 API
TEST

VUH
= 120,000
2 X
VUH
Time 15,000 4 2
Virtual Users Hours of test Times of test
execution

14 © Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Customer Feedback
• “HPE's latest performance testing service will help IT
teams to begin load testing earlier and earlier, with an
on-demand model that is simple and elegant. It's an
impressively comprehensive solution, nicely
designed and very easy to use” (Mark T)

• “StormRunner is very simple and easy to use. Even my

manager could run a load test.”
• "Very helpful to agile teams - saves a lot of time"
• “Analysis is very good, very helpful for my team”

• "You're making it too easy to create and run a load test”

15 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
Why StormRunner Load?
Agile cloud performance testing for modern apps

Simple Smart Scalable

• Easily extends LR and PC
• Really fast spin up (tests start in minutes – no waiting for and paying for
LGs)
• Don’t worry about infrastructure for your test
• Real-time analytics and quick access to data after test complete.
16 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
Why HPE performance testing

17 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
HPE performance testing solutions
Performance
StormRunner Load LoadRunner Center
Performance on-premise
testing solutions Delivered on SaaS

Monitor with SiteScope

Profiler solution
Diagnostics
to pinpoint root cause

Detect network behavior Network Virtualization

Virtualize test environment Service Virtualization

18 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
Selecting the HPE performance testing solution

Customer needs for performance testing

What app need Web and mobile

to be tested? Any application
(test in the cloud)
Where will the
test be Cloud-based,
On-premise
executed? on-demand

What type of Simple, scalable,

performance test Easy, fast, powerful, Global and complete
and agile
is required? site-specific, end-to-end
AUT in the cloud
project-based test performance testing
delivered by HP

Performance Center
StormRunner Load LoadRunner
on-premise
Delivered on SaaS

19 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
HP performance testing solutions matrix

Capabilities StormRunner Load LoadRunner Performance Center

Network Virtualization Yes Yes Yes

Cloud
Platform/price Premise, pay as you go Premise, pay as you go and SaaS
On-Demand

Support multiple platforms/protocols Web and mobile 50+ 50+

Strong analysis engine Yes Yes Yes

Auto correlation Yes Yes Yes

Supports browser-based and native mobile application Yes Yes Yes

Topology Yes Yes

Asset sharing Yes Yes

Performance requirements & defects Yes

Lab management Yes

Production data as baseline

Yes
(performance application lifecycle)

Central repository for scripts, results, and analysis Yes Yes

20 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
 HP performance testing solutions

StormRunner Load LoadRunner Performance

Cloud testing for Agile On Premise Project Center
On-premise and SaaS
Based
Simple Easy Shared

Smart Fast Global

Scalable Comprehensive Complete

HP performance testing add-on products

Service Virtualization Network Virtualization Diagnostics

Pinpoint root cause
Simulate a service’s Detect Network
issues
behavior Behavior

21 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
 HP performance testing solutions

StormRunner Load
Simple, smart and scalable cloud testing

Simple Smart Scalable

Easily design and create load test Understand anomalies and Automatically scale to 1M+ vUser
in under 10 minutes problems in real-time using load tests
predictive analytics

Provisioning Real-time and off-line analysis

SRL: 5-10 minutes SRL: immediately

22 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
 HP performance testing solutions
LoadRunner
Easy, fast, comprehensive and now free (on-premise)
Easy
• Flexible delivery model: cloud or on
premise
• Flexible licensing: daily, term or
perpetual
• Test in 2 simple steps: record the user
flow and run the test Simulate simple
or complex transactions with the
TruClient Technology (no scripting
knowledge required)
• Simple licensing: No more controller
costs, pay as you go
• Add Virtual User days using Paypal™
or your credit card
23 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
Fast
• Run tests anywhere or everywhere, at
any time
• Scale in the cloud as needed from
multiple places in the world
• Deliver rapid feedback throughout
Development. LoadRunner integrates
with Dev tools for continuous test
(jUnit, nUnit, Eclipse, MS Studio,
Selenium)
Comprehensive
• Test it all: Web, mobile and hundreds
other types of apps
• Understand the network impact as
part of your testing with the exclusive
HP Network Virtualization product
• Analyze results in real-time and with
complete coverage
• Supports the latest application
technologies
• Virtually unlimited scalability
 HP performance testing solutions
Features comparison
StormRunner Load LoadRunner Performance Center
Summary Provides a lightweight self-service, SaaS Designed to support project-based application Takes the LoadRunner tools and
solution for testing Web & Mobile applications. performance testing across a wide variety of manages them across the enterprise,
Leverages TruClient technology, and the ability application technologies ranging from providing web access to shared scripts,
to run scripts created by LoadRunner, while Mainframe to Mobile scenarios, results and test planning and
requiring little to no additional software. management including infrastructure and
licensing
Focus On-demand, browser-based solution for highly Simple desktop solution for project teams Enterprise solution providing web-based
scalable testing of Internet-facing applications access to test planning, execution and
management
Technologies Web, mobile & API only Broad technology support Broad technology support
supported
Software Required None, software delivered as part of the service VuGen, Controller, Analysis VuGen, Controller(s), Analysis, PC
Server, ALM Server, database
Procurement Self-service, purchased through Pronq.com Sold through HP Software Sales and Partners, Sold through HP Software Sales and
or through Pronq.com (VUDs only) Partners, HP SaaS and Managed
Service Providers
Licensing Pay-as-you-go subscription – Virtual User Term/Perpetual/VUD licensing Term/Perpetual/VUD licensing
Hours (VUH)
Deployment Pure cloud-based, multitenant, on-demand On-premise and managed by partners; allows On-premise and managed SaaS; allows
SaaS offering cloud bursting cloud bursting
Notes Cloud-based solution only; AUT needs to be in Allow you to run a mix of tests both on-premise and using the public Cloud. LR/PC cloud
the public cloud in current version. bursting allows you to provision LGs in the cloud from your on-premise installation to scale
up and out as needed.

24 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
Why HP
Marketplace validation

Trusted by
• 40% of Fortune/Global 500 customers, more than any other load
testing tool/product
• The most federal/defense agencies, financial institutions, and
manufacturers worldwide
• SAP, Cerner, Capgemini, Infosys, etc.
• Millions of users worldwide

Legacy of leadership
• Inventor of Performance Testing
• Leader in application performance since 1994

25 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
Why HP

HPE has you covered

With solutions for your needs and budget

• Market leadership and innovation

• Scalable solutions to support any size organization
• Integrated products for the entire application lifecycle
• Expertise and best practices
• Flexible licensing and deployment models
• Broadest technology and platform support in the industry
• Extensive ecosystems of partners and IT professionals for
local support and resources

26 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
 Why HP
Endorsed by leaders in their respective industries

Financial Institution Post-production British Sky Broadcasting

Lowers application defects, Achieved 100 per cent Performance testing cycles application failures Increases Performance
boosting customer uptime on MyResults reduced by two weeks or reduced by 80% Testing Throughput by
satisfaction and service more 150%
levels

27 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
HP INTERNAL ONLY - CONFIDENTIAL
 Questions and Answers

Build the
Quality
Into your
application

28 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
 Thank You

For More Information

Email us or call me at:

Hewlett Packard Enterprise

Deliver to the
CorTechs, Inc. HPE
13921 Park Center Road EDS Drive customer
Herndon, VA 20171 Herndon, VA 20171
(904) 347 – 3114
their
rlinton@cortechs.com Kathey.Sanders@hpe.com
Vision

29 © Copyright 2016 HPE. The information contained herein is subject to change without notice.
© 2016 CorTechs, Inc.