Wall Street & Technology is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Infrastructure

10:33 AM
Phil Lynch and John Mitchell
Phil Lynch and John Mitchell
News
Connect Directly
RSS
E-Mail
50%
50%

The Myths of Data Management

The amount of data needed by the average investment firm has exploded on every front. More venues, portfolios, customization, indices and data-dependent asset classes have driven up volumes. Valuations are now needed daily or even intraday -- not just monthly and quarterly. Balance sheet information, sales reports, regional economic projections and staff track records are becoming as important as fundamental and technical data. Even if the big-name aggregators could provide all that, other new sources would still be essential to gain competitive edge.

Hedge funds have recognized this for years; they regard non-traditional information as a major asset. But what has really changed is the swell of operational complexity in processing these increased volumes. There is much greater demand for real-time understanding of valuations, exposures and risk. Both investors and regulators want more transparency and proof that management has put adequate procedures, controls and risk checks in place -- along with robust audit trails, operational oversight, and accurate and timely reporting. Regulatory arbitrage is out of the question; demonstrating a consistent approach, whether to pricing or risk management, is unavoidable.

The problem of volumes & static solutions

In short, firms have to get more data, do more with it, more often, and in a shorter timeframe. It is no longer something that can be avoided, ignored or delegated down the chain of command. A culture of data governance is needed to create robust processes around every aspect of data sourcing, selection and deployment, and to make sure they are adhered to. And just like corporate governance it needs to go all the way to the top of the organization.

Here's the first problem: Investment systems were never built for this volume of data and complexity. Risk management, trade processing or accounting platforms weren't designed to cope with the daily information onslaught. After a decade of spending on the glamorous front office and trading floor, the investment focus must switch backstage to data management solutions that are needed to power trading, risk, compliance, modeling and accounting platforms.

And here's the second -- and far bigger -- problem: The one-size-fits-all, static solution that many vendors prescribe will not solve all data-related problems across the enterprise. These are not solutions; they are another problem waiting to happen.

From one size fits all to fit-for-purpose

Any data management infrastructure has to be appropriate for the size of the firm and the type of operation. The solution that is right for a 40-person hedge fund is very different from the solution needed by a global custodian with thousands of customers and tens of thousands of employees. Most firms have multiple business units, product lines, and investment strategies -- all of which require different data sets used in different ways. Compliance and risk management will need different data sets than the trading desk. Operations want data on actual holdings, while analysts use it for modeling, stress-testing and 'what if' scenarios. Clearly there's no single solution for these distinct requirements.

Of course it is critical that every department operates from the same accurate, verified and unified data source. You can't have accounting and trading working with different numbers. Data is now a strategic concern with a large number of touch points across the business whose requirements are changing much more quickly than ever before. The idea that you can impose a monolithic data management structure, with a single data set and a single management tool, onto the modern business with all its complexities is manifestly flawed.

With too many objectives, such a system is over-reaching, over-ambitious and over-complicated. It takes too long to implement and only solves the problems faced at the beginning of the project -- not those at the end. No wonder it has failed so often. With data volume on an irreversible upward trend, it's only a matter of time before such solutions collapse under their own weight.

Finding the right balance

In the real world, different parts of the firm have different IT infrastructures and operational structures and are trying to solve different problems. Where one wants to expand the asset classes or the geographical reach of their products, another will need to address compliance issues or reporting challenges. Rather than trying to solve everything at once, it is more logical to take a prioritized approach: address immediate business problems, get the data right, deliver returns and move on to the next challenge.

That requires a degree of pragmatism that is often missing from the world of data management. Meeting different business requirements demands a dynamic, federated model that brings together key enterprise data in centralized environment, while also enabling individual units to own their data rules, mandates and preferences. Instead of relying on centralized control alone, data is distributed and made available in a truly actionable and accessible form.

It is critical not to lose sight of the broader issues. You can't have lightweight, siloed systems that will not stand the rigors of today's volumes -- and those you'll face tomorrow. You need much more flexibility and scalability than that.

Keeping sight of the long-term

Vendors need to engage with their customers and understand their problems and their long-term strategy, but few do. These are not systems to be changed every five years; rather, they are fundamental to business infrastructure and its ongoing success. A down-and-dirty implementation of an out-of-the-box system might look like a quick and easy solution, but it isn't. It's just sticking plaster on a rotting wall.

This is no time for inadequate solutions and temporary palliatives. There's no question that volumes will keep growing, regulatory pressures will increase and operational complexities will multiply. It will continue to become harder to mine, manage and make data useful without significant investments in automation. Accurate, accessible and accurate information, however, will remain essential for gaining competitive advantage and higher returns in today's trading and investment environment.

This is why it is time to call out old-fashioned ideas about data management, and expose them for what they are: Myths.

About the authors: Phil Lynch is president and CEO, and John Mitchell is vice president of Asset Control.

Register for Wall Street & Technology Newsletters
Video
7 Unusual Behaviors That Indicate Security Breaches
7 Unusual Behaviors That Indicate Security Breaches
Breaches create outliers. Identifying anomalous activity can help keep firms in compliance and out of the headlines.