Closing the Quality Gap: Firms Look To Short-Term Corrective Testing Strategies
As system interdependency continues to grow and IT infrastructures become ever more complex, financial services firms are spending more to remedy post-event quality failures rather than properly investing in failure elimination at the outset. For financial services organizations today, software quality is the lifeblood of efficient operations, but still, many do not pay enough pre-emptive attention to ensure systems are fit-for-purpose to support increasing usage and regulatory demands.
SunGard’s Meeting the Testing Challenge reportexplores the current state of system testing in the financial systems industry throughout Ireland, the UK, U.S. and Middle East. The survey found that while there is some intent in improving testing practices, there is still a distinct lack of sufficient investment required to pre-empt or mitigate failures at source.
Despite intent toward improvement, notable system failures still occur as we have seen over the past few years. The costs involved in such quality failures can range from millions to billions of dollars in after-release fixing, maintenance and reputational damage – still, the problem continues to prevail in a big way.
If these were one-off incidents we could surmise that the industry is learning its lessons. However, we only have to look at examples like the U.S. healthcare.gov website becoming mired in technical glitches and bugs or when a German regional bank transferred money twice to thousands of customers in error to see that quality failures still prevail – and there are many, many more recent examples of quality failures across the globe that can be used to support this viewpoint.
While some of the findings uncovered in the survey were expected, others generated surprise –considering the type of failures mentioned, the turmoil experienced in financial markets in recent years and the subsequent shift to reduce the costs associated with systems delivery to support key financial activities.
In the Meeting the Testing Challenge survey, respondents were asked to highlight the most important factors that restricted the potential to improve and introduce efficiencies into testing processes.
• Fifty-nine percent stated that budget restrictions were their most prevalent issue with many respondents citing testing cost in overall project spend as another major factor. Testing is not typically the most expensive part of system development, but it is by no means an insignificant cost.
• While nearly half of respondents (49%) said testing accounts for 25% or less of project costs, 23% said that their testing expense exceeds that percentage.
• Nine percent of respondents said testing accounts for 50% or more of project costs, and while 59% said there was an appetite to improve testing, a whopping 41% selected, “no, I do not have any impetus to improve at this time.”
Given these findings and the quality failures we continue to see, it seems logical then that improving the testing process is the first step to improve quality and reverse the defect cost curve and overall project spend. However, the study puzzlingly found that only two-thirds of firms are willing to commit 25% more budget than their previous year spend to improve testing practices while only one in 20 stated that they plan to increase their testing budget by 50% or more in order to introduce such efficiencies.
In order to truly reduce costs associated with testing, the testing process has to change, and that change must relate to an increase in the quality of software put forward. Cutting the test team to reduce costs may reduce your wage bill, but this strategy does not naturally lead to an increase in quality and an elimination or mitigation of the problems we’re seeing. Quite simply, the opposite is likely to occur and quality will suffer.
If the “status quo” continues to reign, the rising cost of failure will continue its path upward. Fear of failure, however, should not be the only reason for improving quality. Besides reducing costs, changing testing practices to embed quality from the outset can enable firms to generate increased sales opportunities through longer-term improved reputation and customer perception.
The simple message is: all firms have the power to make the necessary changes required to move towards the path of improvement, and it’s worth noting that the price of simple change is not prohibitive. The focus, therefore, needs to move from meeting deadlines just for the sake of meeting deadlines to becoming more quality-oriented, more efficient, and thus more effective in IT software testing practices. In doing so, quality should improve, costs should reduce, and reputational and organizational value should be enhanced.
To learn more, download the full report: “Meeting the Testing Challenge: A Look at the Growing Role of System Testing in Financial Services.”
—Stephen O’Reilly, quality assurance practice lead, SunGard Consulting Services
Tweet This