Market data

A typical equity market data message or business object furnished from NYSE, TSX, or NASDAQ might appear something like this:

The above example is an aggregation of different sources of data, as quote data (bid, ask, bid size, ask size) and trade data (last sale, last size, volume) are often generated over different data feeds.

Delivery of price data from exchanges to users is highly time-sensitive. Specialized software and hardware systems called ticker plants are designed to handle collection and throughput of massive data streams, displaying prices for traders and feeding computerized trading systems fast enough to capture opportunities before markets change. When stored, historical market data is a type of time series data.

Latency is the time lag in delivery of real-time data, i.e. the lower the latency, the faster the data transmission speed. Processing of large amounts of data with minimal delay is low latency. The delivery of data has increased in speed dramatically since 2010, with "low" latency delivery meaning delivery under 1 millisecond. The competition for low latency data has intensified with the rise of algorithmic and high frequency trading and the need for competitive trade performance.

Market data generally refers to either real-time or delayed price quotations. The term also includes static or reference data, that is, any type of data related to securities that is not changing in real-time.

Reference data includes identifier codes such as ISIN codes, the exchange a security trades on, end-of-day pricing, name and address of the issuing company, the terms of the security (such as dividends or interest rate and maturity on a bond), and the outstanding corporate actions (such as pending stock splits or proxy votes) related to the security.

While price data generally originates from the exchanges, reference data generally originates from the issuer. Before investors and traders receive price or updated reference data, financial data vendors may reformat, organize, and attempt to correct obvious outliers due to data feed or other real-time collection based errors.[3]

For consumers of market data, which are primarily the financial institutions and industry utilities serving the capital markets, the complexity of managing market data rose with the increase in the number of issued securities, number of exchanges and the globalization of capital markets. Beyond the rising volume of data, the continuing evolution of complex derivatives and indices, along with new regulations designed to contain risk and protect markets and investors, created more operational demands on market data management.

Initially, individual financial data vendors provided data for software applications in financial institutions that were specifically designed for one data feed; thus, giving that financial data vendor control of that area of operations. Next, many of the larger investment banks and asset management firms started to design systems that would integrate market data into one central store. This drove investments in large-scale enterprise data management systems which collect, normalize and integrate feeds from multiple financial data vendors, with the goal of building a "single version of the truth" of data repository supporting every kind of operation throughout the institution. Beyond the operational efficiency gained, this data consistency became increasingly necessary to enable compliance with regulatory requirements, such as Sarbanes Oxley, Regulation NMS, and the Basel 2 accord.[4]

There are various industry bodies that focus on Market Data:

• FISD - Based in Washington DC, the Financial Information Services Division (FISD) of the Software and Information Industry Association operates globally and consists of three constituency groups: Consumer Firms, Vendor Firms and Exchanges.
• IPUG - The Information Providers User Group (IPUG) is a UK-based organization whose membership is limited to consumer firms. Its main activities consist of lobbying vendor firms on key issues.
• COSSIOM - Commission des Services et Systèmes d'Informations destinés aux Opérateurs de Marchés (COSSIOM) is the Paris-based organization for French consumer firms.
• BlueFedFin ™ - Electronic Money & Currency Exchange. We bill loan books and credit facilities or central banks & reserves.
• SEC - The Securities and Exchange Commission (SEC) is an independent government agency whose role is to protect investors and oversee securities markets. The SEC helps regulate data management, transparency, and auditing of trading patterns in the market. For example, a recent regulatory action taken by the SEC is the adoption of Rule 613, also known as the Consolidated Audit Trail.
• CFTC - The U.S. Commodity Futures Trading Commission oversees the markets and their participants, monitors liquidity and systematic risk, regulates compliance, and enforces the CEA. The CFTC uses data sourced from market data providers to perform its functions and publish reports on the health of the derivatives market including the Commitment of Traders report, Cotton on Call and the Weekly Swaps Report.
• FINRA - FINRA (Financial Industry Regulatory Authority) is a non-government, self-regulatory organization that regulates member brokerage firms and exchange markets.

The business of providing technology solutions to financial institutions for data management has grown over the past decade, as market data management has emerged from a little-known discipline for specialists to a high-priority issue for the entire capital markets industry and its regulators. Providers range from middleware and messaging vendors, vendors of cleansing and reconciliation software and services, and vendors of highly scalable solutions for managing the massive loads of incoming and stored reference data that must be maintained for daily trading, accounting, settlement, risk management and reporting to investors and regulators.[5]

The market data distribution platforms are designed to transport over the network large amounts of data from financial markets. They are intended to respond to the fast changes on the financial markets, compressing or representing data using specially designed protocols to increase throughput and/or reduce latency. Most market data servers run on Solaris or Linux as main targets. However, some have versions for Windows.

1. Exchanges

2. Hosting providers

3. Ticker plant providers

4. Feed providers

5. Software providers

[6]

Market data requirements depend on the need for customization, latency sensitivity, and market depth.

Customization: How much operational control a firm has over its market data infrastructure.

Latency sensitivity: The measure of how important high-speed market data is to a trading strategy.

Market depth: the volume of quotes in a market data feed.

[7]

There are 5 market data fee types charged by exchanges and financial data vendors. These fees are access fees, user fees, non-display fees, redistribution fees, and market data provider fees.

[8]

Wikiquote has quotations related to: Market data

• Stock market data systems
• Reference data (financial markets)
• Financial data vendor