Testing early and often while trending performance metrics with on-demand delivery

Background

Expleo worked with a client operating in an Agile environment producing a suite of webservices. The Webservices were deployed and tested nightly as standard to verify functionality. Performance issues were reported with the webservices periodically which were difficult to troubleshoot.

Challenges

  • Test environment not scaled for performance testing
  • No existing way of measuring performance in each build
  • Benchmarking and trending of performance between releases was not implemented
  • Limited time and resources to run regular performance tests
  • Shared test environment so other deployments could impact performance
  • Test environment patching could occur at any time without the awareness of the project teams

We are a dedicated team of specialist software professionals, with considerable experience of different clients, industries and technologies. The team provide bespoke, flexible and cost-effective services to enable clients to digitally transform at pace.

Expleo Advanced Solutions Group

Solution

Expleo’s Automation Engineers implemented changes to the Auto-Q accelerator framework to implement new timer functionality. These updates mean that custom response timers can be wrapped around functionality in any Auto-Q derived script within minutes.

The Auto-Q libraries were also updated with a code to configure a database connection to allow response times from the Auto-Q timers to be stored in a database.

Expleo’s Data Analysts then created an interactive dashboard to visualise response time data and trending graphs. These offered the client rapid identification of any changes in functionality between test executions.

The response time visualisation was further integrated to the client’s existing reporting dashboard. This enabled performance of the previous day’s deployments to be a key discussion point for the daily stand ups.

Benefits for the customer

If you have experienced any of the challenges discussed or would like to know more information about our digital assurance and technology support services please contact ondemandtesting@expleogroup.com

Case studies