Adotas

Where media buyers start online

Featured Author

Gary Angel brings over twenty years of experience in decision support, CRM, and software development, to SEMphonic. Gary co-founded SEMphonic and is president and chief technology officer. He's responsible for leading SEMphonic's development of Web analytics and SEM decision making tools for web marketing professionals. In addition, he helps companies like WebMD, Intuit, American Express and Charles Schwab maximize their web channel marketing through intelligent use of Enterprise Web Analytics

More articles by Gary Angel





Features

Tracking Search Epiphenomena: Why This Behavioral Anomaly is Vital in Web Analytics

Written on
Oct 13, 2006 
Author
Gary Angel  |
Share
Tracking Search Epiphenomena: Why This Behavioral Anomaly is Vital in Web Analytics

For one content area we tested, the average visitor had seven lifetime visits and averaged more than sixteen pages per visit. Both numbers are way above the site average. Is this content area a winner? The question is a trick one — because I haven’t given you any of the essential information to answer it.

Why not? Well, it turns out that in most cases viewing a content area is entirely epiphenomenal to the kind of statistics I’m talking about here. To get to the content area in question, visitors tended to be dramatically more engaged with the site. In other words, the visitors who found the content were the sort that were already quite likely to have many visits and view lots of pages. The content area view didn’t cause the type of visitor — the type of visitor caused the content area view.

In fact, by implying that we found one content area like this I’ve misrepresented the case. Because we found many, many content areas like this – which is part of what helped convince us that the effect was epiphenomenal and not causal. For ad-based sites, smaller, less frequently visited content areas will almost look like big winners when viewed on an average visit/view basis.

So how can ad-based sites understand when an effect is merely epiphenomenal and not central? We’ve found several methods of analysis to be much more fruitful.

First, it’s important to understand that a content area might be successful in more than one way. Some content is inherently single-use – once a visitor has consumed it, there is no reason to expect them to come back. For single-use content, the type of success we’d expect to see is measured most effectively by subsequent visitor returns without viewing the target content.

On the other hand, many kinds of content area are only working well when they are gathering repeat viewers. For this kind of content, the type of success we’d expect to measure is subsequent visitor returns to the original area.

Let’s tackle this second metric first. In a sense, it’s a measure of the mindshare that a particular content area grabs from total site visits. And to measure it, we track how many of a visitor’s visits (and pages) include the target area. By measuring “mindshare” over time, we were able to screen off the vast majority of epiphenomenal effects — and establish a much better measure of how influential a content area actually is on return behavior.

But what about tools (and content) that are inherently single use? For this type of content, we’ve found that the most effective analysis is essentially to construct an artificial A/B test. We construct a population segment of first-time content area users and then create a matching set (across key variables like pages viewed and prior sessions) of visitors who didn’t see the content. By measuring the difference in subsequent over-time return behavior, we have a measure of whether or not the content actually improved (or degraded) visitor loyalty.

It’s unfortunate, but the vast majority of visitor segments and web KPIs are extremely vulnerable to measuring effects that are mere artifacts of the site navigation and the types of visitors that are most likely to stumble on them. This problem is exacerbated by the restrictions that many web analytic tools place on the complexity of the rules that can be used to create a visitor segment and in their limited ability to track the sequence of events over-time.

For ad-based sites, segments that are built off simple rules about viewing content and use common core KPIs like average visits or page views are almost guaranteed to be misleading. Segmentation (like conversion) has often been put forth as the “right” and necessary way to do web analytics. And, of course, it is very important. But just as measuring versus conversion is far more complicated than it might at first seem, so too can segmentation be badly mishandled. Taken simplistically and measured against the wrong type of KPIs, visitor segmentation can steer both analyst and publisher disastrously wrong!

All of which make epiphenomena pretty darn important. So now, I’m going to go check Google and see if I’m ranked ahead of the Wiki…





Reader Comments.

Many electronic publishers (and transactional sites) are struggling to address the issues that you outline, namely:

-Which statistics matter?
-Where are the actual “choices” occuring that can be affected?
-Given competing objectives (page views vs click revenue), how do I optimize?

There is a suprisingly simple answer to these questions. Properly structured tests enable the publisher to;

-Focus attention on the communication attributes that actually impact behaviour.
-Quantify the impact across multiple independent objectives.
-Weight the objectives based on their relative value.

This framework empowers a combined exploration, discovery and optimization cycle that can be used to optimize content across page views and revenue for different customer segments.

We are seeing this used with great effect for leading publishers and e-commerce sites to gain new insights and improve month-month results.

Posted by Hikaru Phillips | 2:03 pm on October 13, 2006.

Leave a Comment

Add a comment

Pages: « previous page 1 2

No Tags
Article Sponsor

More Features


  • Right now, at the beginning of 2012, what are you watching the most closely for its ad and marketing opportunities?

    View Results

    Loading ... Loading ...

Latest News

News Archive

Spotlight

Sponsormob Leads the Way Into RTB for MobileADOTAS – For more than half a decade, Berlin-based tech firm Sponsormob has remained relevant in an industry characterized by [...] more...


Adotas Partnership