Headline analyzers put to the test using famous headlines

headline analysis tools

Admit it. You feel pressure when writing headlines.

How could you not? So much hinges on you getting that one line right.

According to David Ogilvy:

“On the average, five times as many people read the headline as read the body copy. When you have written your headline, you have spent eighty cents out of your dollar.”

I’ve been a copywriter for nearly two decades and I still second guess myself, even when I come up with a page full of solid headlines options.

So when I discovered headline analyzers, (http://coschedule.com/headline-analyzer http://www.aminstitute.com/headline/ and http://headlines.sharethrough.com/) I was excited. But I was also skeptical. Headline writing is both an art and a science. How accurate can these tools really be?

To find out, I decided to see how they would rate some of the most well-known and regarded headlines of all time. You can see the results below. But first, let’s take a look at each of the three analyzers.

The CoSChedule headline analyzer assigned a score from 0 – 100 based on factors such as headline type, length and sentiment, as well as which types of words make up the headline.

The Advanced Marketing Institute’s Headline Analyzer compares the words in a headline with the words on its Emotional Marketing Value (EMV) Impact list to calculate the headline’s EMV percentage.

Sharethrough’s tool gives scores for overall quality, engagement and impression using a complex algorithm based on behavior model theory and neuroscience and advertising research.

These are the ad headlines I chose and how each analyzer scored them.

They Laughed When I Sat Down At the Piano But When I started to play!—

This is John Caples’ most famous headline. And that’s saying a lot. He was one of the most successful and influential copywriters of all time. He was inducted into the advertising hall of fame in 1978 and even has a prestigious award named after him.

This particular ad brought in record response for the client, the U.S. School of Music, and continued to run for several years.

So how did it fair in the headline analyzers?

This headline scored a 68
This is how CoSchedule graded Caples’ most famous headline.
Headline EMV: 20%
This headline had an EMV score of just 20%.

Sharethrough score: 68

Caples headline scores
You would expect higher scores for such a successful headline.

Maybe that’s just an anomaly. Let’s see how the next headline does.

“At 60 miles an hour the loudest noise in this new Rolls-Royce comes from the electric clock”

David Ogilvy wrote many successful ads, so picking just one headline to test was a challenge. But this might be his most famous one. Plus, we wrote that it was the best headline he’d ever written. That’s good enough for me—but apparently not for the analyzers.

The CoSchedule grade is 41
CoSchedule’s analyzer only gives this classic headline a 41.
This headline's EMV score: 11.6%
This headline had a surprisingly low EMV score.

Ogilvy Sharethrough score: 84

Ogilvy headline Sharethrough scores
This headline performed better in this analyzer than the others.

Let’s try a shorter automobile headline.

Lemon

It doesn’t get more iconic than this ad headline. It is one of the most well-known and recognized in Ad Age’s top ranked advertising campaigns of the twentieth century.

Surely this will rank well in the headline analyzers.

Lemon scores a 0 from CoSchedule
CoSchedule gives the lowest score possible to this iconic ad.

This headline failed to even register in the EMV analyzer.

Lemon Sharethrough score

Lemon headline scores
Lemon scored poorly in the Sharethrough headline analyzer, too.

That’s probably fitting given that William Bernbach was leading the agency that created this ad. He would have denounced these headline analyzers before the results were even delivered.

Maybe the problem is that you need an image of the car to provide context. So let’s look at a headline that stands on its own.

How a “fool stunt” made me a star salesman

This headline is often cited as an example of effective headline writing. Even such luminaries as John Caples, Victor Schwab and Dan Kennedy have included it in their books.

Here are the results from the headline analysis tools:

This headline scores a 68
This headline gets a 68 from CoSchedule’s analyzer.
headline EMV score: 33.33%
This headline got an EMB score of 33.33%

Fool stunt headline Sharethrough score

fool stunt headline scores in Sharethrough
This headline didn’t score as well in the Sharethrough analyzer as it did in the others.

A little better than the others, but still not great. Let’s look at a couple more.

Do you make these mistakes in English?

The ad this headline was taken from didn’t just work. It worked for an insane amount of time. It ran for over 40 years!

And the results of the headline analysis are…

This headline gets a 75 from CoSchedule
CoSchedule actually gives this one a decent score.
Headline EMV:
This headline scored the best in this analyzer, too.

Mistakes headline Sharethrough score: 66

Mistakes headline Sharethrough scores
This headline’s scores are nothing special.

All the examples so far are classics from years past. Will something a little more recent do better?

For more information on lung cancer, keep smoking

You might have seen this anti-smoking headline making the rounds on the internet. It’s clever, memorable and speaks to the reader’s self-interest.

The headline analysis scores are shown below.

CoSchedule score = 64
CoSchedule gives this one a 64.

Headline EMV score: 25%

Smoking headline Sharethrough score

Smoking headline Sharethrough scores
This headline scores well in some areas and poorly in others.

Conclusion

As you can see, these tools are far from foolproof. To be fair, CoSchedule’s tool is meant for blog posts rather than advertisements. But I suspect you’d have similar results running blog heeadlines.

While there are certain elements you can find in effective headlines, there is no formula or algorithm that can guarantee or predict success.

So what can you do to improve your odds of nailing the headline?

First, make an effort to understand why successful headlines work for their intended audiences. Go beyond specific words, length and variables and consider the larger strategy. What’s the psychology behind it, and how does that translate to other situations?

Second, run your own split tests. For landing pages, you can use a program like Optimizely or Visual Website Optimizer. Or if you prefer a free option and have a little bit of tech savvy, Google Analytics includes a testing feature.

To test blog post headlines, Thrive Themes has an outstanding new tool.

 

Feature image by Jiri Navratil (Own work) [CC BY-SA 4.0 (http://creativecommons.org/licenses/by-sa/4.0)], via Wikimedia Commons

6 thoughts on “Headline analyzers put to the test using famous headlines

  1. It is impossible to attach an effective test to an algorithm without including the visual presentation, audience context, and psychological prompt or offer.

    Engagement often comes from enticement or intrigue. In an age when audience attention spans are virtually non-existent, longer headlines are rarely better. That is supported by the statistics which show the lack of time spent reading body copy.

    The outdoor advertising rule holds pretty true. That’s why “great” headline/concept are so rare that they become timeless, transcending media and generation. Less IS More!

    1. I totally agree about the context. There is no one-size-fits all. Even best practices don’t always work best in every situation.

    2. I agree with Tony…in a print ad (or electronic ad with visual), context is everything. The analysis samples you’ve shown are truly great headlines. They worked. That’s the test. They not only worked, we’re still talking about them. Take THAT, analysis algorithm! That’s the problem with any automated tool. It has no soul.

  2. Sean, I have a client who demands I use the AMI analyzer for everything I write for him (blog posts, newsletter headlines, etc.)

    So… good news and bad news: for a blog post telling the story of a man who used the client’s product to beat osteoporosis, I scored 100%! (The headline was, “Meet David. He Beat Osteoporosis”)

    The bad news? Well, at AMI, I have to choose a “category” such as Health & Medicine, Automotive or Shopping before you get a score. I chose Health and Medicine.

    Then I ran the headline with some other categories — and each one gave it a 100%.

    So, I guess it does not really matter to AMI who the audience/target is – every headline works for every market.

    Peter T. Britton
    The Write Answers

    PS: I got another 100% a few days later for a different blog post.

    1. Thanks for commenting Peter.

      That right there is one of the biggest reasons to be skeptical. Matching the right copy to the right audience is so vital.

      But pleasing clients is important, too. They pay the bills. So kudos.

  3. I agree with Tony…in a print ad (or electronic ad with visual), context is everything. The analysis samples you’ve shown are truly great headlines. They worked. That’s the test. They not only worked, we’re still talking about them. Take THAT, analysis algorithm! That’s the problem with any automated tool. It has no soul.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.