Performance & Load Testing - How to get real user performance experience

Performance & Load Testing - How to get real user performance experience from Testpoint Pty Ltd

By: Testpoint Pty Ltd  11-Apr-2012
Keywords: Performance Testing

Performance & Load Testing - User Experience
When managed correctly, Performance Testing can clearly help you access "YOUR" risks and enable informed decisions. Planning for performance testing is like planning for your future with the peace of mind that your investment will work on go-live. Your strategy for Performance testing should include a measure of real user experience response times otherwise your decision is based off risky theoretical or simulated conditions which can represent a completely different behaviour.

Our experience with managing various performance projects continues to help our customers identify and rectify performance bottlenecks and application stress points earlier in the development cycle which dramatically reduces their costs and improves stakeholder confidence.

It’s no doubt your performance test strategy will require a load testing tool to simulate a large number of users navigating your application. The rate, throttle and load is a standard load testing technique required to measure your applications ability to handle the traffic expected and most organisations have this part covered.

We take the process once step further by utilising any of your conventional automated functional testing tools (Selenium, QTP, RFT, Rational Robot, Testpartner, TestComplete...) to perform client side real user experience performance tests. The tool integrated within single line calls to capture transactional performance counters using TestPoint’s Stream Test Pro framework ensures you can simulate real user experience performance tests across any geographical region.

Let’s take the example of a customer using both QTP and Selenium for their automated functional testing solution. They have invested quality time in automating a regression suite to validate the applications functional components across builds and configurations when the application regresses.

Integrating STP now provides several key benefits.

1) The first is noticeable immediately as your automated functional regression tests can now capture performance response statistics allowing you to monitor and compare your applications performance while running functional regression tests. The data is measured based on your performance counters providing a real time simulation for each test cycle and across your build and configuration. Your test team can now provide statistics such as the minimum, average and maximum response times including thresholds recorded for a specific period and criteria meaning any key areas which show up as a performance risks can be reported earlier and traced back to the test case scenario, subsystem and requirement including a link to the applications screen grab and story board helping identify the issue. 

“It goes without say that the earlier problems can be identified, the better chance you have of dealing with them..."

2) The second major benefit of using STP with your functional testing tool is you now have the ability to run your required tests or parts of your tests along with your load testing exercise. This now provides a real chance of recording client side user experience performance tests while a defined load exists against your application. The process of capturing the response times and key performance metrics is completely managed by STP and centralised for access both in real time (while tests are running) and post runs. The data is accessible and made easily available for historic/future comparison utilising trend reports, run view and performance bench view graphs/data export features. The process of providing a health performance report becomes a natural instant process and no-longer a difficult effort.

Keywords: Performance Testing

Other examples of best work from Testpoint Pty Ltd

Comprehensive Data Validation from Testpoint Pty Ltd thumbnail
18-Apr-2012

Comprehensive Data Validation

Once implemented and aligned to the customers testing strategy, what normally would require 3 key resources, 10 business days of manual testing effort, is dramatically managed to aproximately 1 hours reproducible testing effort. The cycle is accurately repeatedable across any software release. Imagine the benefit for agile team environments where nightly releases are a standard practice including intra day deployments?


07-Mar-2012

Your Testing Experience is about to be tested down the quarter mile!

TestPoint has transformed what was known to be an expensive, long term investment into a sensible immediate real time benefit to our clients. Your business Requirements, Test Case   Traceability and plans including the verification process is automated allowing project management to accurately measure the status using meaningful data. 


15-Feb-2012

Demonstrating testing with a real purpose!

To keep things simple, If you’re struggling to link your manual test cases to business requirements, user stories or the applications functional components then you’re guaranteed to experience automated testing without a purpose costing your business both thousands of dollars, software failure and embarrassment.


The most popular methods of mobile usability testing from Testpoint Pty Ltd thumbnail
13-Feb-2012

The most popular methods of mobile usability testing

The tester can go as far as capturing video evidence of animated transitions using STP's inbuilt video capture process. We are not referring to your artificial simulators here, we are actually running referring to real tests against the real thing! So your testers are validating your business mobile application using real devices and logging the test execution/validation process detailing PASSED, FAILED or INCOMPLETE steps.


Instantly Impressed- Top External Testing Company from Testpoint Pty Ltd thumbnail
06-Jan-2012

Instantly Impressed- Top External Testing Company

Right from my initial tender bid meeting with TestPoint I was instantly impressed. The organisation is clearly structured to deliver, nothing is too much trouble and they are without a doubt one of the top external software testing companies that I have ever had the pleasure to engage with during my own career in IT.


Stream Test Pro -  The enterprise Selenium Automation Framework. from Testpoint Pty Ltd thumbnail
05-Jan-2012

Stream Test Pro - The enterprise Selenium Automation Framework.

STP will bridge the gap for Selenium users by providing a mature enterprise quality test management solution (testing tool) which integrates seamlessly with various IDE’s such as VSTS and Eclipse. Complete STP functionality will be accessible ranging from, data source integration, screen capture and casting, test reporting, test case design, requirements and test plan mapping, database validations, traceability for all your test artefacts.


Can't find my test cases! from Testpoint Pty Ltd thumbnail
20-Sep-2011

Can't find my test cases!

Even expensive software testing tools on the market which claim they assist with mapping out test cases to requirements can make things harder when trying to identify a Test which was developed for a particular functional area. Simply put searching for a simple keyword within the body of your test artefacts is generally the most important feature your project team can have on site


Please help! we need to performance monitor and test our production systems every 5 mins. from Testpoint Pty Ltd thumbnail
26-Jul-2011

Please help! we need to performance monitor and test our production systems every 5 mins.

A corporate financial giant was about to give up on their attempts to implement a performance monitoring and testing solution for their top 10 production critical systems, only until they engaged TestPoint to implement an out of the box adaptable product solution. Stream Test Pro was capable of providing exactly what the business required which is real time, live production response times against all 10 core business systems. The business requirements were to capture over 1


TestPoint offshore testing platform from Testpoint Pty Ltd thumbnail
25-Jul-2011

TestPoint offshore testing platform

TestPoint has successfully setup an offshore testing platform that will not only reduce your costs by up to 70% but will provision for the key components required for a successful offshore testing solution.


Stream Test Pro, making software testing an effortless task for our professional services division from Testpoint Pty Ltd thumbnail
15-Jul-2011

Stream Test Pro, making software testing an effortless task for our professional services division

The outcome is Stream Test Pro, making software testing an effortless task for our professional services division and users. We can basically guarantee efficiency and quality regardless of the user! It’s like your guaranteed coffee taste experience when visiting a well known franchise outlet


TestPoint Provisioned a Thorough Testing Solution from Testpoint Pty Ltd thumbnail
14-Jul-2011

TestPoint Provisioned a Thorough Testing Solution

TestPoint provided a very thorough testing solution. This included a complete creation of a requirements document for the system (where none had existed previously), and extensive repeated testing of these requirements throughout the system. Testing was implemented in several testing/fix phases, and testing phases themselves were run quickly. Reporting on test progress was also frequent and similarly thorough.  TestPoint provided a very thorough testing solution. This included a complete


RTA introduces Stream Test Pro for SCATS automated software testing! from Testpoint Pty Ltd thumbnail
14-Jun-2011

RTA introduces Stream Test Pro for SCATS automated software testing!

The RTA has transformed this risk into a big WIN! By successfully introducing Stream Test Pro to the SCATS testing team who have reported a reduction in post run analysis and major improvements to real time visibility of testing coverage, progress and quality.


Client SAVES 200 Thousand Dollars per month in lost revenue. from Testpoint Pty Ltd thumbnail
10-Jun-2011

Client SAVES 200 Thousand Dollars per month in lost revenue.

Testpoint Services were engaged as a rescue squad team for a large Australian Development team, struggling to identify and reproduce major problem areas with their online system, costing the organisation over 200 thousand dollars per month in lost revenue