Making Measurement Make Sense (3MS) - Archive
In March 2011, the ANA, IAB and 4A's launched Making Measurement Make Sense (3MS) an industry-wide initiative to propose standards for metrics and advertising currency that will enhance evaluation of digital media and facilitate cross-platform measurement. Since that time, significant progress has been made particularly in the area of shifting digital measurement from a "served" to "viewable" impression standard. The Media Rating Council (MRC), which serves the marketing industry by securing audience measurement that is valid, reliable and effective, is leading the effort toward the transition from served to viewable ad impressions for online advertising transactions.
Below is an update on MRC’s advisory on the viewable impression standard.
MRC Viewable Impression Advisory Update
NEW YORK (Nov. 20, 2013) — Since issuing the first MRC Viewable Impression Advisory in November 2012 and a subsequent update in June 2013, the MRC has continued its work to identify and remove obstacles standing in the way of widespread use of viewable impressions as a digital currency metric. We currently anticipate completing this work by year-end 2013, and lifting our advisory on transacting on viewability by the end of Q1 2014.
In the months since our last update in June, much progress has been made. A viewability measurement standard is near, with completion expected by year-end. At this point, the only significant outstanding issue is determining the duration requirement for a web-based viewable video impression. In addition, many viewability measurement providers have been engaged in MRC accreditation audits. To date, six vendors have been accredited by MRC for their viewability solutions. SafeFrame has been released by IAB, and has been adopted or is in-test across several publishers. Significant learning about the many factors involved with viewable impression measurement has taken place.
As a result, MRC believes the key remaining issue involves reconciling the viewability measurements of different vendors. To address this, we are about to launch a reconciliation project with the viewability vendors that have been accredited by MRC. This reconciliation process will exclusively utilize accredited vendors because their methods have been fully audited, and therefore we have a thorough understanding of the processes that underlie their viewability measurements. The reconciliation process will make it possible to fully understand and explain the differences that exist in viewable impression counts.
Based on what we have learned to date, it is our belief that differences in viewable impression counts among these vendors do not result strictly from differences in their viewable impression counting functions. Rather, a material component is related to other processes in which each vendor engages — including their filtration and/or verification functions — which ultimately affect their calculations of viewable impressions. MRC will further support this observation through the reconciliation project. It is our intention to provide guidance to both the industry and to the viewability vendors about how these differences should be accounted for and minimized moving forward.
As a result of this forthcoming reconciliation work, MRC expects to be in a position to have achieved the key learnings on this matter by year-end 2013, and to communicate these to the marketplace. However, this information may require certain marketplace adjustments, not only by viewability vendors, but also among digital advertising buyers and sellers, which would lead MRC to refrain from lifting its cautionary advisory until these can be sufficiently addressed.
Thus, we anticipate that MRC will fully lift its Viewable Impression Advisory by the end of Q1 2014.
About the Media Rating Council (MRC)
The MRC is a nonprofit industry association established in 1964 composed of leading television, radio, print and internet companies, as well as advertisers, advertising agencies and trade associations whose goal is to ensure measurement services that are valid, reliable and effective. Measurement services desiring MRC Accreditation are required to disclose to their customers all methodological aspects of their service; comply with the MRC Minimum Standards for Media Rating Research and other standards MRC produces; and submit to MRC-designed audits to authenticate and illuminate their procedures. In addition, the MRC membership actively pursues research issues they consider priorities in an effort to improve the quality of research in the marketplace. Currently approximately 90 research products are audited by the MRC.
VIEWABLE IMPRESSION ADVISORY
NEW YORK (Nov. 14, 2012) — The MRC is leading the cross ecosystem movement toward the transition from served to viewable ad impressions for online advertising transactions. Aligned with the Making Measurement Make Sense (3MS) initiative’s recommendation, the MRC believes that online advertising impressions, particularly for brand advertising campaigns, should be viewable in order to be more comparable to other media which afford the “Opportunity to See” as the basis of currency.
Several vendors – including ad servers, verification services and third-party syndicated measurers – have developed solutions for determining whether served ads become viewable and to count ads based on viewable parameters. Based on large-scale tests of real advertiser campaigns as detailed within, while capabilities vary, the ability to consistently measure whether impressions are viewable is a challenge that must be overcome by most of the vendors before finalizing a new online advertising currency definition. The number of impressions in a campaign for which viewability cannot be determined is often significant.
The use of projections to measure viewability is not a recommended solution at the present time because the full range of causes of these viewability undetermined impressions has not been sufficiently identified. Simply put, the MRC believes that more work needs to be done to understand the methods that underlie these techniques and the impact of the viewability of undetermined impressions on the ability to project.
Cross domain iFrames are a significant issue and we support the IAB’s SafeFrame initiative and any others designed to address this issue that may prove to be viable. The SafeFrame initiative will create a communication protocol that will permit determining the viewability of ads that appear in cross domain iFrames. A solution to the iFrame problem must be an industry priority. While cross domain iFrames are the primary reason viewability cannot always be measured, there are other reasons that need to be addressed as fully as possible. Two possible causes that may be contributing are varying capabilities across the viewable vendors and some instances of viewable decision tags simply not “firing.”
Overall, there is a critical need to develop intelligence around unmeasured and non-viewable cases.
MRC recommends that the entire ecosystem continue to test and refine the definitions, thresholds and implementation steps required to transition to a viewable impressions currency for internet media transactions.
Consideration of Current 3MS Proposed Thresholds for Viewability
Pilot results indicate that the current proposed 50 percent of pixels in view for one second is a reasonable threshold for most display ads. However, further analyses must be undertaken. It is highly likely that certain ad types, notably larger ads like the IAB Rising Stars, will require special considerations, and the MRC is actively pursuing solutions including proposing viewability criteria for these ads.
Under the reasonable assumption that strong user interaction with ads (for example, clicking on them) indicates viewability, MRC is considering ways to develop and codify language around the interactions and the viewability thresholds.
Video ads, hypothesized to be largely viewable, require separate consideration for appropriate viewability thresholds, particularly around both sight and sound.
INDUSTRY ACTION ITEMS
MRC believes it is premature to transact on viewability in advance of a fuller understanding of the points detailed in the following paragraphs.
MRC strongly advocates that the buying and selling communities educate their members on the basic findings from the large-scale pilot test:
- There is significant variability in vendor capabilities to measure viewability – we encourage buyers and sellers to seek validated viewability solutions (i.e., solutions that have been audited and accredited/certified against applicable industry standards by an independent 3rd party) and ensure they clearly describe what can and cannot be measured.
- Cross domain iFrames pose a large obstacle to measuring viewability. While partial solutions exist and others are under development, no vendor known to MRC today can determine viewability in all cross domain iFrame situations.
- Other causes that result in an inability to measure viewability must be understood by MRC and the Industry in order to finalize measurement and transactional requirements.
- Of paramount importance to changing the currency is achieving consistently higher levels of measurability.
Currencies and standards can change for the better when the planned analyses and solutions are in place. The point of currencies and standards is to improve the supply chain. Moving to a new, as yet not fully measurable currency on a wholesale basis at this juncture could do more harm than good.
MRC has put forth a timeline that calls for additional learnings and analyses to be generated through Q1 2013. Testing of the SafeFrame solution for cross domain iFrames is also scheduled to happen during this time and, last but not least, a new guideline for viewability will be in market for public comment in Q1 2013. Following the viewability guideline public comment period, MRC believes it would be wise to conduct a full in-market parallel data test to ensure that all parties have an opportunity to evaluate the old and new datasets prior to adopting viewable impression currency for transactions. MRC also suggests that the Terms and Conditions used for online campaigns be adjusted to account for the introduction of viewable impressions as a currency metric.
The following describes the viewable impressions pilot testing in greater detail. We encourage you to read.
VIEWABLE IMPRESSION AGENCY PILOT TESTING SUMMARY
BACKGROUND
In spring 2012, MRC, with the support of the entire ecosystem as represented by the member companies of the ANA, 4A’s, and IAB, and the Board of Directors of the MRC, took on the leadership of efforts to transition digital display advertising to a viewable impression transactional currency. The proposed criteria or standard for viewability, recommended by the industry leaders who participated in Making Measurement Make Sense (3MS), is at least 50 percent of pixels in view for a minimum of one second.
The 3MS initiative envisions viewable impressions as the foundational element in the development of transparent and consistent metrics for display advertising. The intention of the 3MS initiative is to define metrics that work for brand advertisers and permit facile cross platform media planning, buying and evaluation. In addition, the 3MS leadership supports the expansion of the MRC into the foremost standards development institution for all media.
TESTING VIEWABILITY WITH REAL ADVERTISER FLIGHTS
MRC oversaw pilot tests of viewable impressions using real advertiser campaigns in live production environments that ran during May and June 2012. In total, twenty-two campaigns representing more than three billion served impressions[1] were examined. Seventeen advertisers and twelve agencies were involved. The ad campaigns ran in a variety of environments and deployed inventory purchased both directly from publishers as well as from network sales channels. The only requirement that was imposed across all the campaigns, regardless of agency, advertiser brand or target audience, was that the agency ad servers used to serve the pilot campaigns be MRC accredited.
In addition, five viewability measurement vendors participated in the pilot tests. Each vendor was required to demonstrate in advance of its participation in the pilot its ability to measure or not measure viewability under seventeen different scenarios as defined by the MRC.
PURPOSE OF VIEWABILITY PILOTS
The pilot test of actual, live brand campaigns using agency ad servers had three primary objectives:
- Estimate the impact of imposing a viewable criterion on impression counting for display ads;
- Provide a basis for evaluating the efficacy of the proposed minimum of 50 percent pixels in view for a minimum of one second and determine if the proposed thresholds should be adjusted in a final viewable impression standard;
- Discover any other relevant issues that might be important in developing an industry standard for the viewable impression.
PILOT RESULTS
Key findings that have broad implications for the recommended industry action items in this document include:
- Viewable rates for the live campaigns in the test showed tremendous variability, ranging from a high of 78.6 percent to a low of 7.8 percent. Viewable rates are calculated off of a base of impressions that could be measured for viewability.
- The ability to measure whether impressions are viewable or not is still extremely variable. The test campaigns showed a range of 0 to 77 percent of served impressions that were measured for viewability.
- Cross domain iFrames present a challenge to measuring viewability because they can obscure the capacity to determine whether or not an ad impression is viewable. Cross domain iFrames have an important function in protecting content and protecting undisclosed data collection from occurring on a publisher’s site.
- Cross domain iFrames were the reason behind 3/4 of the unmeasured impressions in network placements in the pilot, and more than 1/3 of the unmeasured impressions in publisher placements.
- Overall measured impression rates across all pilot campaigns were 27 percent for publisher placements, and 19 percent across ad network placements.
- Viewable rates varied by ad sizes within placement types (network/publisher). Rates ranged from 12.6 to 63.7 percent for the most popular ad sizes deployed by the advertisers in the pilot test. Most popular was determined by the number of impressions served.
- Viewable rates observed in the pilot testing for the largest and smallest advertising units, as well as certain rich media executions, showed that the MRC needs to consider appending additional viewable parameters or otherwise altering parameters in certain special advertising circumstances. This is being studied and will be proposed to the Industry in the written viewable impression guideline.
We welcome questions.
About MRC
The Media Rating Council is a nonprofit industry association established in 1964 comprised of leading television, radio, print and internet companies, as well as advertisers, advertising agencies and trade associations, whose goal is to ensure measurement services that are valid, reliable and effective. Measurement services desiring MRC accreditation are required to disclose to their customers all methodological aspects of their service; comply with the MRC Minimum Standards for Media Rating Research as well as other applicable industry measurement guidelines; and submit to MRC-designed audits to authenticate and illuminate their procedures. In addition, the MRC membership actively pursues research issues they consider priorities in an effort to improve the quality of research in the marketplace. Currently approximately 80 research products are audited by the MRC. Additional information about MRC can be found at www.mediaratingcouncil.org.
###
[1] Served impressions are the current industry standard, used for the selling and buying of digital display.