Quantitative Creative Testing: The Solution to Ad Fatigue


By CEO Brian Bowman, Consumer Acquisition

Here’s a prediction for 2019: Facebook advertising will be even more competitive.

Not much of a revelation, is it? Facebook advertising has become more competitive every year. Thanks to new features like value bidding, Facebook now offers a palette of advertising tools that anyone with decent Facebook advertising skills can use to compete directly with major brands.

This means more advertisers can use the platform profitably. However, as the playing field becomes increasingly level, advertisers lose one of their key competitive advantages: better ad tech.

As ad tech becomes less and less of a competitive advantage, advertisers have to find a new way to stay ahead of the pack.

So what’s left? Creative. In particular, the type of breakout creative that delivers outsized results. Not just 10x ads, but 100x ads.

The vast majority of new ad creative will fail. This is why we need a systematic approach for finding breakout, 100x ads.

You can’t recognize this type of super creative just by looking at it. This isn’t an issue of “I think this ad will do better.” Opinions don’t matter – performance matters. Breakout creative often doesn’t look like anything terribly special until you put it into a live campaign and look the reports. Then, that one humble little ad starts to look very different from all the rest.

This is why creative can be such a competitive edge. But only if you know how to find the 100x ads.

To find the 100x ads will require you to develop a lot of ads. You’ll also have to test the bejesus out of them. That’s the other challenge with creative testing: 95% of new creative will fail to beat the current best-performing ad (aka “the control”).

That means you don’t need one new ad. You need twenty. Because you don’t need just any ad – you need an ad that will outperform your current winner. You need the 5%. So you have to create twenty ads to find that one gem.

Let’s not forget about ad fatigue, either. As you know, ads don’t last forever on Facebook. And the bigger your budget, the faster they fade. For advertisers spending $1 million or more per month, ads can fade in as little as four to seven days.

Take that into consideration, and now you need twenty new ads each week.

Impossible? No. It just requires the ability to scale up creative development and testing in a way that most advertisers aren’t doing. We call it Quantitative Creative Testing.

Quantitative Creative Testing is not quite a/b split-testing, and not quite multivariate testing. But it is specifically designed for creative production for Facebook ads and Google’s Universal App Campaigns (UAC).

Here’s how to do it.

Creative Testing Basics

There are two flavors of ad creative tests: Concepts and Variations.

Here are the key differences:

Concepts (Large changes. Large impacts.)

  • Concepts are brand new, completely different ads. They are big “outside the box” style approaches that can result in large improvements to revenue and to large losses. Concepts are the core drivers of creative success on Facebook, but they have to be used in a limited way because when they fail, they tend to fail badly.

Variations (Small changes. Small impacts.)

  • Variations leverage pieces of winning concepts. They reposition existing elements to create something similar but new. Because variations don’t have the big differences that concepts have, and because they’re based on high-performing ads, variations tend to generate smaller, incremental wins. And smaller losses.


Creative Testing Phases

We break the Quantitative Creative Testing framework into five phases, and the general idea is to spend about 80% of the time optimizing the best ads and creating new variations. This limits the amount of non-converting spend, and also lets us prototype and iterate new ads rapidly. The remaining 20% of the time is spent with new concept ideation – big “pie in the sky” ideas that often fail but sometimes generate a 100x ad.

Phase 1: Competitive Analysis

Before we start creating new ads, it’s smart to see which ads competitors are running, and which of their ads appear to be successful.

To do this yourself, set aside an hour or two and identify your top ten competitors for Facebook ads. You can conduct a creative audit from their Facebook page if you look under the “Info and Ads” tab. This won’t tell you how well the ads are performing, but it shows you what ads the company is running. Paid competitive tools like Social Pita can provide deeper performance analytics.

Take notes and screenshots of what you find during your competitive analysis, whether it’s done on Facebook or with a paid tool. Look for ideas you could use in your own ads.

It’s worth your time to do this background work. It will optimize your ad spend because you’ll be creating ads that are similar to other companies’ best-performing ads. It will also give you a good creative framework based on what companies like yours are doing.

Facebook recently added the “Info and Ads” tab, which lets anyone see which ads a page is running.

Phase 2: Simple Variation Testing

Now we’re into the actual creative testing, but we’re going to start carefully. Simple variation testing is where we basically tear apart ads that are already working and find out which elements of those ads are driving results.

This minimizes the financial risk of inherent in testing, and it will also give us some best practices to apply to new ad concepts later.

Here are a few of the elements we like to test:

  • Calls to Action / Buttons
  • Text headers: Text placement, text length (4-6 words tend to perform best), text color and font. Text versus no text.
  • Image format (square, horizontal, vertical, stories)
  • Video length: 6, 10, 15 seconds.

 Once you know which element or elements are the primary performance drivers, then you have some very valuable information. It can be used going forward for ad variations and for new ad concepts. This variation testing basically gives you a “best practices” template for future ads.

Phase 3: Advanced Variation Testing

Advanced Variation Testing takes everything we learned from competitive research and ad elements testing and uses it to start building new ads.

As you know, there’s an awful lot to test. Here are some of our favorites:

  • Start and End Cards. There are plenty of things to test with cards, aka calls to action. Try placing them at the beginning, or the end of videos. Test which call to action to use, and CTA colors.
  • We’ve found that primary colors work best – the bolder the better.
  • Ad copy. Different ad copy, the placement of the ad copy, copy color and font. No ad copy.
  • Showing a mobile device in the ad versus not showing a mobile device.
  • Background image. Busy, or plain? Colored, or a patterned background? We’ve found that simpler backgrounds tend to perform better.
  • Image layout. Split screen? Split it vertically or horizontally? Or try a grid of images. Horizontal, vertical?
  • As you know, images matter a lot, and so they get tested a lot. Often, we test images based on whether they user-generated or stock photos. Typically, user-generated photos, or photos that look like they are uuser-generated outperform “magazine-like” photos.
  • One product versus multiple products.
  • Include or exclude the AppStore logo and Google Play Badges. Removing the logo tends to lift performance about 15%.
  • Logos and brand placement. Top, bottom, left or right? Or none at all… ads often perform better without branding elements.

It might seem like a lot, until you look at real ads and see all the possible combinations.

Phase 4: Benefit & Demo in Motion

These tactics leverage Facebook’s “Create to Convert” feature that lets advertisers take still images and convert them into videos.

Create to convert offers four ways to make stills into videos:

  • Basic motion: Add one or two moving elements in front of a still image.
  • Brand in motion: Your brand or logo element/s move in front of a still image or stock video footage.
  • Benefit in motion: The benefit of your ad or its primary message moves.
  • Demo in motion: Use video of how your app, website, service, product or feature works, shown over a static image so it looks like the ad is showing someone using your app (or website, etc.).
Phase 5: Best Practices for Concept Ideation

This is where we try to capture lightning in a bottle and produce a breakout, 100x ad. About 95% of ads will fail to outperform your existing ads, and some of those losing ads will fail hard. To minimize the losses, usually, about 20% of creative work is focused on new concepts.

To develop these new concepts, you’ll need to:

  • Leverage what you learned from your competitive research on Facebook
  • Use storytelling skills to frame, present, and create new concepts. You’ll need a storyteller on your team who can explain what an app does or offers in a concise, compelling way.
  • Leverage character animation and new assets in new ways. If you have a celebrity or a very well known brand, try making them the stars of the ad. If you don’t, test including or excluding characters to see if they help or hurt performance.
  • Create variations of all these new concepts, drawing on what your simple variation testing taught you about which ad elements and combinations of ad elements tend to work best.
Going Forward

This is the full process of Quantitative Creative Testing. Clearly, it’s a lot of work. Not every advertiser has the bandwidth to develop this much creative, or to manage this many tests. But it can be done, and it works. It can definitely help your Facebook ads regain a competitive edge.



Please enter your comment!
Please enter your name here